This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 



< 



United States Patent m 

Beat et al. 



iiiinnii 

US005I55845A 

[it] Patent Number: 
[45] Date of Patent: 



5,155,845 
Oct. 13, 1992 



[54] DATA STORAGE SYSTEM FOR PROVIDING 
REDUNDANT COPIES OF DATA ON 
DIFFERENT DISK DRIVES 

[75] Inventors: David G. Bea), Longmont; Fred C. 

Eifert, Louisville; Henry S. Ludlam, 
Longmont; Charles A. Milligan, 
Golden; George A. Rudeseal, 
Boulder; Paul R. Swiatek, Lafayette, 
all of Colo. 

[73] Assignee: Storage Technology Corporation, 

Louisville, Colo. 

[21] Appl. No.: 538,911 
[22] Filed: Jun. 15. 1990 

[51] Int. CI.* G06T 11/20; G06F 13/00 

[52) VS. a 395/575; 364/DIG. 1; 

364/245,3; 364/268.5; 371/10.1 

[58] Field of Search 371/10.1, 9.1, 11.1; 

364/245.3, 268.5; 395/575 

[56] References Cited 

U.S. PATENT DOCUMENTS 

3,581,286 5/1971 Beausolei! 364/200 

3,725.864 4/1973 Clark ct al 364/200 

3.964,056 6/ J 976 Charpentier et a] 364/200 

4,342,079 7/1982 Stewan et a! 364/200 

4,779.189 10/1988 Lcgvold et al 364/200 

4,837,680 6/1989 Crockett el al 364/200 

4,862.411 8/1989 Dishon et al 364/952 

4.897.781 1/1990 Chang et al 364/200 

4.897.782 1/1990 Bennett et al 364/200 

4,958.273 9/1990 Anderson et al 364/200 

5,051,887 9/1991 Berger et al 364/200 



FOREIGN PATENT DOCUMENTS 



0109981 
0239323 
02995 U 
0303856 
0352028 
WO82/02784 



6/1984 
9/1987 
1/1989 
2/1989 
1/1990 
8/1982 



European Pat. Off. . 
European Pat. Off. . 
European Pat. Off. . 
European Pat. Off. . 
European Pat. Off. . 
PCT Infl Appl. 



WO85/02926 7/1985 PCT Infl Appl. . 

OTHER PUBLICATIONS 

Dishon, Disk Dual Copy Methods and Their Perfor- 
mance, FTCS-18 Digest of Papers, Jun. 1988, Tokyo, 
Japan, pp. 314-319. 

Control System of Main Storage Device, Patent Ab- 
stracts of Japan, vol. 006, No. 206 (P-149) Oct. 19, 1982, 
JP 57 111,900. 

Frush, Graceful Degradation in a Multiple Data Path 
Environment, IBM Tech. Disci. Bulletin, vol. 16, No. 3, 
Aug. 1973, pp. 912-914. 

Primary Examiner— Charles E. Atkinson 
Attorney, Agtnu or Firm— Dorr, Cason, Sloan & 
Peterson 



[57] 



ABSTRACT 



A disk storage system that writes multiple copies of 
records directed to user-specified volumes. A plurality 
of spaced apart control units interconnected by direct 
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when a write request is received by one control unit to 
cause one volume in each set of recording means to 
write a copy of the received record. 
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DATA STORAGE SYSTEM FOR PROVIDING 
REDUNDANT COPIES OF DATA ON DIFFERENT 
DISK DRIVES 

5 

FIELD OF THE INVENTION 

This invention relates to a data storage system and, in 
particular, to an improved facility for providing redun- 
dant copies of data records. This invention further re- 
lates to a data storage system of the DASD (direct 10 
access storage device) type which responds to a host 
processor write request to provide multiple copies of a 
data record on separate disk drives of separate DASD 
subsystems. The invention still further relates to a 
DASD type system wherein each subsystem controller 15 
includes a cache memory for the provision of cached 
read and write operations on multiple copy service. 

BACKGROUND OF THE INVENTION 

Peripheral data storage subsystems of the DASD 20 
type utilizing magnetic disk units and the like arc known 
for writing and reading data records under control of 
one or more connected host processors. With the high 
reliability of present-day DASD subsystems it is an 
acceptable business risk for many users to employ 25 
DASD facilities that maintain only a single copy of 
each stored record. However, some users require in- 
creased protection for some of their data against the loss 
of data availability that would result from a failure of a 
DASD subsystem element such as, for example, a disk 30 
device. Although the facilities needed to provide a 
higher degree of data availability are clearly more ex- 
pensive, it is, in some circumstances, an acceptable cost 
to businesses. Examples of such business are banks 
where the stored data may comprise financial records 35 
and airlines where the data may represent reservation 
information. In such businesses, the necessity for the 
greatest possible protection from data loss is such that 
the concomitant increased cost is acceptable. 

It is known to provide equipment which writes a 40 
separate copy of data records on a plurality of disk 
devices. Such an arrangement is shown in U.S. Pat. No. 
4,837,680 of Jun. 6, 1989, to Robert N. Crockett et al. In 
this patent, a DASD subsystem having a plurality of 
disk drives and a single storage control provides dual 45 
copies of each record written by a connected host on a 
specified volume. The host generates a system com- 
mand which causes all records subsequently written to 
a volume specified by the host to be written by the 
storage control onto two different disk drives. While 50 
the Crockett et al. system provides for continued data 
availability if one disk drive becomes unreadable, the 
system is vulnerable in that the failure of the storage 
control itself would cause the data on all disks served by 
the storage control to be unavailable to the host. Thus, 55 
while the Crockett system provides unproved data 
availability, it is still subject to failure in the event that 
an element common to all disk units becomes unavail- 
able. U.S. Pat. No. 4,862,411 of Aug. 29, 1989, to Dis- 
hon et al. shows an alternative arrangement for provid- 60 
ing dual copies in a manner that avoids some of the 
disadvantages of Crockett. Although Dishon solves the 
single failure problem of Crockett, it has a number of 
disadvantages which render it less than ideal for many 
purposes. First of all, it is a requirement in known CKD 65 
(Count Key Data) DASD systems that the distance 
between the host processor and the disk control units 
cannot exceed approximately 240 meters and that the 
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distance from the disk control unit to the disk drive 
controller cannot exceed approximately 60 meters. This 
presents a problem for Dishon for installation where the 
distance between the CPU 10 and the disk drive con- 
troller 42 already approximates the under 300 meter 
limit. In this case, the increased distance of communica- 
tion path 34 extending to the disk drive controller 44 of 
the other control unit 18 may cause the total distance 
between CPU 10 and disk drives 48 to exceed the 300 
meter limit. In this case, the Dishon et al. system would 
be unsuitable unless the second DASD control unit 18 is 
placed immediately adjacent to the first control unit 16. 
In any event, Dishon cannot be used for installations in 
which the disk drive controller 44 of the second control 
unit 1 8 must be positioned more than 60 meters from the 
first control unit 16. This distance is small when consid- 
ering protection of one copy of data from the same 
hazard as could affect the first — e.g., fire, flood, terror- 
ism. 

Another disadvantage of the Dishon et al. system is 
that it does not contain cache memories and therefore 
does not provide the performance advantages of DASD 
control units that do contain cache memories. There 
would be an inherent difficulty in operating the Dishon 
system with cache memories since he provides no 
means of storing duplicate copies of a modified record 
in both cache memories (as is required for data integrity 
in cached write operations.) Thus, even if the two 
DASD control units 16 and 18 of Dishon were immedi- 
ately adjacent to each other so as to present no distance 
problem, there would still be no effective way to pro- 
vide cached read and cached write service in the Dis- 
hon system. 

It is also known to provide dual copy service by 
connecting a host to separate DASD subsystems and by 
having the host apply separate write commands to each 
subsystem which writes the data record to a volume 
specified by the host. While this arrangement provides 
dual copy service and the enhanced data availability 
resulting therefrom, it is operationally undesirable in 
that it requires separate host write commands, and an 
increased utilization of host CPU time, to provide the 
dual copy service. An example of equipment that uses 
two host write operations to provide dual copy service 
is the Tandem Computer Non-Stop Fault -Tolerant 
Transaction Processing System. A second system oper- 
ating in a similar manner is the IBM Transaction Pro- 
cessing Facility. 

It can therefore be seen that it is currently a problem 
in CKD DASD subsystems to provide increased data 
availability while maintaining the higher performance 
levels of cached read and write operations in DASD 
systems not having such severe distance limitations and 
wherein the failure of a DASD system component will 
not make the stored data unavailable to the host. 

SUMMARY OF THE INVENTION 

The above problems are solved and an advance in the 
art is achieved by the present invention which com- 
prises a DASD subsystem in which improved data 
availability is provided by a system in which the failure 
of a single system component will not prevent a con- 
nected host from obtaining access to stored data records 
and wherein the distance limitations of conventional 
DASD systems are significantly expanded. The DASD 
subsystem of the invention comprises a plurality of disk 
or data storage control units (hereinafter DSC) and one 
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or more recording means, such as disk drives, con- cate copy of the data record. This second embodiment 

nected via a disk controller to each DSC. The system provides still greater data availability in that the dupli- 

operates in a conventional manner for a write request in C ate data record remains available to the host even if the 

which only a single record copy is desired. In this case, first DSC be Comcs unavailable. In this case, the host 

the DSC receives the write request from the host and 5 de(ects the conditi on of the first DSC and 

causes one of the disk drives to which the DSC is con- communicatcs ^ the DSC via a data channel 

nected via a disk controller to write the data record. In ewendfa from the hQSt |0 thfi Dsc ^ host 

accordance with the invention, the system creates mul- ™ * j a . .u a i . » ■ , 

tiple copies of a record for a write request received for CMI ih " "f ™* wnte the duphcate copies of the data 

a volume (disk drive) for which the host has priorly 10 r ~° rd * * 0red 0n thc d,sk dnves "> 

specified that multiple copy service is to be provided for ond . 

all subsequent write requests to the specified volume. A st,U h, * hcr dc * ree of data avw,ablIit y * provided 

For this multiple copy service, which is hereinafter bv vct mother alternative exemplary embodiment of 

referred to as extended duaJ copy service (when only the invention. In accordance with this embodiment, a 

two copies are to be provided), the host processor trans- 1 5 P" r of host Processors are connected over separate data 

mits write requests over a channel to a first DSC which channels to both a first and a second DSC which are 

is connected to a group of disk drives and which is directly connected with each other via a direct data 

further connected via a direct data link with a second link. Each DSC is connected to its own individual 

DSC which is also connected to its own group of disk group of disk drives. The host processors can operate 

drives. The details of the manner in which the request is 20 independently and each normally communicates with a 

processed by the first DSC depends upon the type of different one of the DSCs. In other words, each DSC is 

service to be provided. The type of service that can be a primary DSC to a different one of the hosts. On each 

provided by thc system of thc invention includes single write command from a host specifying extended dual 

copy, regular dual copy as shown by Crockett, regular copy service, the primary DSC causes the data record 

fast dual copy, extended dual copy, and extended fast 25 lo ^ wriUe n onto one of its disk drives. The primary 

dual copy . For the extended dual copy service the first DSC a|so a dupKcale ^py of lhc ^ record lo 

DSC enters the received informat.on from the host into ^ wrinen omo lhc djsk unjls J the otnef Dsc ^ h 

its cache and then transmits the information over the Mi r ^t H«t* k.*.., u ~ ~ t^c/- i , 

direct data link to the cache of the other DSC. The Sfcu^^f?^ T f V™? 

information in the cache of each DSC is then written to 30 W,t , a ™*™ failure of a single DSC and* 

the disk drive of each DSC. The host is notified as to thc /0r "* K ?' sk ™ lts I*™* • co PV of "* h 

completion of the execution of the write command only cord to ^ »v^aWe to the host via the other DSC and 

when the record has actually been written into a disk '? d,sk umls * Further In accordance with this alterna- 

drive of each DSC. For the extended fast dual copy tlve arrangement, the system remains operable even if 

service of the present invention, the received informa- 35 onc of thc host processors and one of the DSCs and its 

tion is entered into the cache memory of the first DSC associated disk units fail concurrently. In this case, the 

and transmitted over the data link to the cache memory remaining host processor can take over the duties of the 

of the other DSC. The host is then advised that the fated host. The data records that were written under 

execution of this write command has been completed. control of the failed host remain available to the second 

The two DSCs then subsequently operate on their own 40 host as long as one of the DSCs and its connected disk 

to cause the record data in each cache to be written to units remains available and operable, 

thc disk drive to which each DSC is connected. In accordance with a further possible alternative 

The arrangement of the invention is an improvement exemplary embodiment of the invention, each DSC is 

over the dual copy feature of Crockett et al. in that the connected by two separate direct data links and associ- 

failureofa single system element such as a disk control- 45 a tcd circuitry with the other DSC This duplication 

ler common to all disk drives of the applicants first DSC provides increased data availability since if the one of 

will not prevent the host from accessing the duplicate At direct data !inks bccomcs unavailable, the direct 

copy of the record on a disk drive of the second DSC. communication between thc two DSCs may still take 

In this case, the host can transmit a read request to the lace ^ the other direct dflU link ^ jts connected 

first DSC which passes the request via the direct data 50 



link to the second DSC whose disk drive executes the 



circuitry. 



, mt TT: u " w ""~ U1 ~ Z CACV - U r U1 : In accordance with another possible exemplary alter- 

request, reads the duplicate copy of the record, and , ,. # , # . . . F * J\. 

transmits the record contents over the data link to the ™ X y SS^ . ^ t ""f? ° f 

first DSC and, in turn, to the requesting host. ?°" aI DS £? ^^cxmnected by addmonal direct data 

A second possible exemplary embodiment of the 55 ^ks may be emp^loyed to provide a number of multiple 

invention provides a still higher degree of data avail- copies greater than two. Thus, a system having, for 

ability. It is similar to that above-described except that **™Ple, four DSCs, four sets of disk drives and four 

the host is connected over separate data channels to direct Unks interconnecting the four DSCs could 

both the first and the second DSC. Normally the host uscd lo provide "extended multiple copy service** to 

operates as above-described by transmitting read and 60 generate up to four copies of each record written to a 

write requests to the first DSC which executes the re- specified volume of each DSC. 

quests on its own connected disk drives. The first DSC * n view of the above, it can be seen that the above 

is also connected in this alternative arrangement over embodiments of the invention provide the high degree 

the direct data link to the second DSC and, on each of data availability that many businesses require for 

write operation that requests extended dual copy scr* 65 circumstances in which all possible steps must be taken 

vice to a specified volume, it communicates with the to ensure the availability of recorded data under the 

second DSC over the direct data link to cause the sec- most extreme and unlikely occurring events that may 

ond DSC and its connected disk drives to make a dupli- transpire. 
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DESCRIPTION OF THE DRAWINGS similar t0 Cr0ckc " bv causin « a rccord to writtcn to 

two or its disk drives 109. 

These and other advantages and features of the inven- On each write request for volumes for which the 

tion may be better understood from a reading of the extended duplicate copy of the invention is desired by 

following description thereof taken in conjunction with 5 host 101. DSC 105 transmits the received write request 

the drawing in which: over data , ink m to D SC 107 which causes an ex- 

FIG. 1 comprises a block diagram illustrating one tended duplicate copy of the record to be written by the 

^* S * * x f m P ,ary embodiment of the invention; appropriate one of its disk drives 11 Mn this manner 

FIG. 2 illustrates an alternative exemplary embodj- and for volumes specified by host 101, a copy of each 

Tbm v oveV^ * flVai1 * l ° rCCOfd ° n ° ne 0f disk driv « 109 is *o written 

abihty over the embodiment of FIG. 1; on one of<Jisk dHvcs m ^ of FIG. 1 pro- 

J£L J % Z'llttT * W' tXC ? p] *% vidc * incrcased dat * availabilit y ™ «h« would 

£^%£^ and whlch prov,des stlH ***** d *r, m ' °f™ - *? ,ink 

FIG. 4 illustrates another alternative exemplary cm- , 5 106 ™ n0 P™ ldcd - In ™** d daU avadabduy is 

bodimem that is independent of host channel distance pr0 ? ,d f d Vl* £T " m^i, ° f 
limitations- controller 112, which would make all records on disk 

HO. 3 illustrates further details of a disk storage d !L vcs 109 h <> st 101, DSC 105 and DSC 

control (DSC); 107 ' can ^change the commands required to read the 

FIGS. 6, 1 and 8, when arranged as shown in FIG. 9, 2 0 cxtended du P lic * le co Py of the record that exists on disk 
illustrate further details of the system of FIG. 5- dnves 111 Thc readout information is transmitted from 

FIG. 10 discloses further details of the IBC element disk drivcs m > over interface 110, DSC 107, data link 
of FIGS. 6-8; 106 » Dsc 105 and interface 104 back to host 101. 

^r^cr^f 0108 " fUrthCr dCtaiIS ° f thC 101 ClCmCmS Description of FIG. 2 

614 Of r IG, 8; 25 

FIG. 12 discloses a system equipped to provide ex- FIG - 2 discloses a system similar to FIG. 1 but which 

tended multiple copy services; has improved data availability. Host 101 is additionally 

FIG. 13 discloses further details of a system equipped connected via channel 103 and interface 104-1 to DSC 

to provide extended multiple copy service; 107. Host 101 normally communicates with DSC 105 

FIG. 14 discloses a channel program command se- 3^ and causes data records to be written onto disk drives 

quence used to provide extended multiple copy service; 109. On each write operation to volumes specified by 

FIGS. 15-17 disclose further details of the command the host for extended dual copy service, DSC 105 trans- 
sequence of FIG. 14; mils each write command over data link 106 to DSC 

FIGS. 18-22 disclose the messages transmitted over 107 to cause an extended duplicate copy of the record to 

data links 106 for the provision of extended multiple 35 be recorded onto a disk drive 111. The system of FIG. 

copy and connectivity service; and 2 provides increased availability since upon a failure of 

FIGS. 23-25 disclose the messages and commands DSC 105, host 101 can communicate with DSC 107 via 

exchanged between system elements for the provision channel 103 and interface 104-1 to read the copies of the 

of extended dual copy service. data records that exist on disk drives 111. Host 101 may 

DETAILED DESCRIPTION *° continue to operate in a normal manner and communi- 

. . cate with DSC 107 and its drives 111 until DSC 105 is 

Description of FIG. 1 repaired and brought back on line. 

FIG. 1 discloses one possible exemplary embodiment rwrri t* r Fir- \ 
of a system embodying the invention. FIG. 1 discloses a inscription oi r 10. 3 
host processor 101 connected via a channel 102 and a 45 FIG. 3 discloses yet another alternative exemplary 
channel interface 104 to DSC 105 which is connected embodiment of the invention which provides greater 
over interface 108 to disk controller 112 and its disk data availability over that shown on FIGS. 1 and 2. In 
drives 1094) through 109-n via paths 116-0 through the system of FIG. 3, an additional host processor 121 is 
116-9. The system of FIG. 1 further comprises a data provided which is connected via channel 122 and inter- 
link 106 which interconnects DSC 105 with a second 50 face 124-0 with DSC 105 and is further connected by 
DSC 107 which may be identical to DSC 105. Data link channel 123 and interface 124-1 with DSC 107. Both 
106 ideally may be optical fiber but, if desired, may be hosts 101 and 121 may operate concurrently and inde- 
tny type of transmission path such as metallic conduc- pendent] y with each normally communicating only 
tors. DSC 107 is connected via interface 110 to its own with its primary DSC and connected disk drives. Thus, 
disk controller 113 and via paths 117-0 through 117-9 to 55 host 101 may normally communicate primarily with 
disk drives 111-0 through 111-n. DSC 105 and its disk drives 109 and host 121 may nor- 

Host 101 communicates in a conventional manner malJy communicate primarily with DSC 107 and its disk 

with DSC 105 via interface 104 to transmit record write drives 111. However, on each write operation by either 

and read requests to DSC 105. DSC 105 receives these host for volumes specified for extended dual copy ser- 

requests and communicates over interface 108 with disk 60 vice, the data record is written not only on the disk 

controller 112 and disk drives 109 to execute the write drives of the DSC with which the host normally com- 

and read requests. The system of FIG. 1 processes write municates, but by means of data links 106, the other 

requests that do not involve extended dual copy service DSC causes an extended duplicate copy of each such 

in a conventional manner similar to that of known record to be recorded on its disk drives. Let it be as- 

DASD systems. Namely, DSC 105 receives the request 65 sumed that host 101 normally communicates primarily 

from host 101, processes the request and causes the with DSC 105. On each write operation for a specified 

record to be written on one of disk drives 109. The volume for which an extended duplicate copy of the 

system of FIG. 1 can provide regular dual copy service record is desired, DSC 105 transmits a command over 
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data link 106 to DSC 107 to cause a duplicate copy of generate records which are transmitted over path 124-1 
the record to be recorded on disk drives 111. In a similar to DSC 107 which causes these records and associated 
manner, assume host 121 normally communicates only control commands to be transmitted over direct data 
with DSC 107 and its disk drives 111. However, on links 106 to DSC 105. DSC 105 responds to the recep- 
each write operation for volumes for which extended S tion of these commands and records and causes the 
dual copy service is desired, data links 106 and DSC 105 records to be transmitted over path 106 and via disk 
cause an extended duplicate copy of the data records to controller 112 for writing on a selected one of disk 
be recorded on disk drives 109. drives 109. In this manner, certain data records written 

Upon a failure of disk drives 109 and/or disk control- by the users of both host processors 101 and 121 are 
ler!12, and/or DSC 105, host 101 may continue normal 10 written on disk drives 109. This permits the users of 
operation by communicating with DSC 107 over inter- both host processors to share the data records stored on 
face 104-1 to operate with the extended duplicate re- disk drives 109 that pertain to the work activities corn- 
cords on disk drives 111. Host 121 may continue normal mon to both groups of users. 

operation in a similar manner upon the failure of disk This writing on disk drives 109 of data records gener- 
drives 111 and/or disk controller 113 and/or DSC 107 15 ated by host processor 121 may be accomplished either 
and operate with the extended duplicate copies of the with or without the use of extended dual copy service, 
data records that exist on disk drives 109. The system of If there is no need to have these records also recorded 
FIG. 3 provides still further system availability in that on a disk drive 111, the system may operate as just 
upon a failure of a host, such as host 101, host 121 may described so that the data records generated by host 
perform duties of the failed host by operating upon 20 processor 121 are transmitted via DSC 107 to DSC 105 
either the original or the extended duplicate copy of the for writing on a disk drive 109. On the other hand, the 
records that exist on disk drives 109 and 111. writing of the records generated by host 121 and per- 

. . taining to joint work responsibilities may be accom- 

Descnption of FIG. 4 phshed using extended dual copy service wherein a first 

FIG. 4 discloses an embodiment of the invention that 25 copy of the data record is written on disk drive 111 
is a degenerate version of the system shown in FIG. 3. operating as a local volume and by having the second 
The system of FIG. 4 is similar to that of FIG. 3 except copy of the data record written on a disk drive 109 
that each host is connected to only a single DSC. The operating on a remote volume basis, 
system of FIG. 4 is advantageous in systems in which The above-described joint sharing of data records by 
the hosts are separated from one another by a distance 30 users at two different host processors is advantageous in 
greater than 480 meters, which is twice the priorly situations in which the DSC and disk controller and 
discussed 240 meter limit applicable to conventional disk drives associated with a first host processor are 
CKDDASD systems. In the system of FIG. 4 the hosts situated at a distance sufficiently remote from these 
may be separated from each other by a considerably corresponding elements and a second host processor so 
greater distance, for example 5 km. The two DSCs may 35 that the aforementioned DASD operational distance 
be separated from one another by this same distance. limitations are exceeded. In this case, the system of the 
However, the distance between a host, such as host 101, present invention permits useful system operation with 
and its disk drives 109 must still meet the aforemen- a distance of up to approximately five kilometers for 
tioned 300 meter limit. data links 106. 

The system of FIG. 4 is not limited to the provision of 40 It may be seen in view of the above that the systems 
extended dual copy service. It can also be used in instal- shown on FIGS. 1, 2, 3 and 4 provide greatly improved 
lations in which DSCs 105 and 107 are separated by a data availability for users who must lake all practicable 
considerable distance, such as 5 km, and where it is steps to ensure a high degree of data integrity and data 
desired to have host processors 101 and 121 share a availability under all possible adverse operating condi- 
common set of disk drives, such as for example, disk 45 tions. 

drive 109, for the storage of some of the data records r» ■ ■ e tri/^ 

generated by both host processors. For example, let it Description of FIG. 5 

be assumed that host processor 101, DSC 105, disk FIG. 5 shows further details of the system of FIG. 3. 
controller 112 and disk drives 109 are in a first work Specifically, FIG. 5 shows a plurality of host processors 
location which is separated from a second work loca- 50 101 through 121, connected to DSC 105. DSC 105 is 
tion containing host processor 121, DSC 107, disk con- connected via disk controller 112 to disk drives 109-0 
troller 113 and disk drives 111. Let it be further assumed through 109-n. DSC 105 is connected to data links 106-0 
that for some of their work assignments, the users at and 106-1 which extend to DSC 107. DSC 105 corn- 
host processor 101 work independently and create data prises storage clusters 501 and 507 each of which corn- 
records that are recorded on disk drives 109. Let it 55 prises a pair of storage paths and a multi-path storage 
further be assumed that the users of host processor 121 director. Storage cluster 501 comprises storage paths 
also have certain independent work assignments and 504 and 506 and multi-path storage director 503. Stot- 
record the data records pertaining to these assignments age cluster 507 comprises comparable elements 508, 509 
on disk drives 111. However, let it also be assumed that and 511. Host 121 is connected over path 134-1 to multi- 
thc users of host processors 101 and 121 have certain 60 path storage director 503 of cluster 501 and over path 
common work assignments for which it is desired to 134-0 to multi-path storage director 508 of cluster 507. 
have users of both host processors write the data re- Host 101 is connected over path 104-1 to storage direc- 
cords pertaining to these joint assignments on disk tor 503 and is connected over path 104-0 to storage 
drives 109. director 508. 

For these joint assignments, the users of host proces- 65 In a manner well-known in DASD subsystems, DSC 
sor 101 work in the conventional manner so that their 105 contains cache memory 512 having a volatile store 
data records are recorded on disk drives 109. For these portion (VS) 521 and a non- volatile store portion (NVS) 
joint work assignments, users of host processor 121 520. Conductors 108-0 and 108-1 interconnect storage 
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paths 504 and 506 of storage cluster 501 with disk con- Let it be assumed that DSC 105 receives a write 
troller 112. Conductors 108-2 and 108-3 connect disk request for a volume that a user has priorly specified is 
controller 112 with storage paths 509 and 511 of cluster to be operated with extended dual copy service. This 
50? received write request is initially processed by the stor- 
The function of DASD sub-systems containing DSCs 5 age cluster 501 or 507 that receives the write request 
and disk drives is well-known in the art and is shown in and, in a manner similar to the IBM 3990 system, the 
the IBM publication GA32-0O98-0. "Storage Subsystem request is transmitted via conductors 108 to disk con- 
Library IBM 3990 Storage Control Introduction", first troller 112 which ultimately causes the write request to 
edition, published in 1987 by the International Business be written by the disk drive 109 comprising the user 
Machines Corporation and available at any IBM local 10 specified volume. The storage cluster receiving this 
branch office. The DSC and disk drives of the present request also communicates with cache 512 and causes 
invention perform many functions in a manner similar thc writc rcquest to ^ slorcd in 5 i 2 . Cache 512 
to that of the IBM 3990 Storage Control and its disk ^ thc storagc clustcr opcratc cooperatively to extend 
drive*. Therefore, the functions of the DSC 105 of the the rcqucsl over onc ofdaU hnks I06 -0 or 106-1 to DSC 
present invention that are similar to those of the IBM 15 107 . The request is received and stored in the cache 
3990 ,»y«™ only briefly mentioned herein. The of DSC 107. The cache memory of DSC 107 
functions of DSC 105 of the present m .vntion that are and onc of its st c)ustcfs ^ thc fCCcivcd 
not comparable to those of the IBM 3990 system are , ^ cause a of thc rccord {Q ^ writtcn on 
described in detail. Qnc of ^ disk ^ ' m 

.k^Sm^SSi ^ f °? % m a DSC 105 can *° 0 ^ atc <° writc ™ «< cndcd d ^ 

the IBM 3990 system for host read and write requests ^ r * f - 4 ,. , , . . 

. . J . . — „ + M , A . J H . copy of a record on one of its disk drives 109 when the 

that are received by DSC 105 for execution by disk - */ f , . . . , . r 

a^* — iaa . i_ ■ u n er i<u • . j • .t. * irsl co ?y of the record is written on a disk drive 111 of 

drives 109 to which DSC 105 is connected via paths ,Ju . . . « ft _ 

108. The two storage paths within each cluster provide ? SC ,07 * !? * hlS C ^ D f SC 10 .7 ves ^ n c r ^ uest 

separate facilities thafmay be used concurrently to 25 for a s Pf° lfi ^ volum< ; for extended dual copy 

provide separate communication paths between the *™ cc f h f* been priorly requested and causes the first 

host processors and the disk drives 109. Each storage CO P y ° f the r ~° rd t0 * wn " c " ' «L ° n n c , of dlsk ?" v * 

path within a cluster may independently process a host 111 The °* ch * memory withm DSC 107 transmits the 

read and write request. As in the IBM 3990 system, rC *™L°?Z ^if^Ti^ t0 ? Ch * ? OTOry 512 

volatile store (VS) 521 and non-volatile store (NVS) 30 ° f J 05 ^ 105 of r FIG " 5 Following this, cache memory 

520 are used on write requests requiring the services of 512 md one of stora « c clusters 501 or 507 i0 

cache memory 512. Read requests normally require the MUSe M «"««fc d dual C0 PY of record to be made 

service of only VS 521. b * onc of dlsk drives ,09 - 

By way of distinction from the IBM 3990 subsystem, DSC 105 is comparable to the storage control shown 

the system of FIG. 5 additionally contains data links 35 in thc aforementioned IBM 3990 publication in that it 

106-0 and 106-1 which extend to DSC 107 which may Mrves a plurality of host processors, that it contains a 

be separated a considerable distance, such as five thou- P air of "orage clusters each of which contains a single 

sand meters, from DSC 105. As is subsequently de- multi-path storage director and a pair of storage paths, 

scribed in detail, this permits the system of FIG. 5 to Except for the extended dual copy operations, the other 

operate with DSC 107 and its disk drives 111 to write 40 s y* tcm functions of the system of FIG. 4 need not be 

extended duplicate copies of records recorded on speci- further described since they are similar to those of the 

fied disk drives 109. IBM 3990 system. 

TTje IBM 3990 system provides user controllable Description of FIGS. 6 through 8 

duplicate copy service of the type shown by Crockett * 
that is limited to a single DSC and its disk drives. In 45 FIGS. 6 through 8, when arranged as shown on FIG. 
other words, when requested by a host processor, the ^ disclose further details of the system of FIG. 5. Thc 
IBM 3990 system can cause duplicate record copies to left side of DSC 105 on FIG. 6 connects to a plurality of 
be written by two different disk drives connected to a host processors 101 through 121 and on its right side on 
single DSC In the IBM 3990 system, a user generates a FIG- 8 connects to a plurality of disk drives 109 via disk 
host system command which instructs its DSC that all 50 controller 112. As on FIG. 5, DSC 105 comprises a pair 
write requests to certain user specified volumes are to of storage clusters 501 and 507. The elements compris- 
be executed by causing duplicate copies of each record ing storage cluster 501 are shown in detail; the elements 
to be written to the specified volumes. The duplicate comprising storage cluster 507 are shown only diagram- 
copies are written by two different disk drives con- matically since they are identical to those of storage 
nected via one or more disk controllers to a single DSC. 55 cluster 501. 

While the conventional IBM 3990 dual copy arrange- The host processors are connected via channels and 
ment provides improved data availability over a single paths to ICI elements 601 within each storage cluster, 
copy mode of operation, it is subject to failure if the Each host processor is connected to two different ICI 
single DSC or disk controller 112 serving the disk elements in each cluster. Thus, host processor 121 is 
drives 109 containing the two copies should fail. 60 connected via channel 123-0 and path 134-10 to ICI 
In the system of FIG. 5 and in accordance with the element 601-0. Host processor 121 is also connected via 
invention, the user generates a host command sequence channel 122-0 and path 134-11 to ICI element 601-n of 
that is transmitted to DSC 105 instructing it that on all cluster 401. Host processor 121 is further connected via 
subsequent write requests to a user specified volume, channels 123-1 and 122-1 and over paths 134-00 and 
extended duplicate copies of the records are to be writ- 65 134-01 to ICI elements (not shown) within storage clus- 
ten with one copy being written by a disk drive 109 and ter 507, These connections permit each host processor 
with the other copy being written by a disk drive 111 of to have a plurality of connections to each storage clus- 
DSC 107 on FIG. 3. ter so as to provide a non-blocking configuration in 
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which a requesting host will normally have an available the data flow fails to meet the protocol. In this case the 

connection to each storage cluster. ICC element advises microprocessors 608 and 613 of 

As is the case in the IBM 3990 system, each storage this condition so that the microprocessors can take the 

cluster provides a pair of storage paths extending to disk required remedial action. 

controller 112 and disk units 109. These duplicated 5 A read or write request received by a particular ICI 

paths permit each storage cluster to serve a pair of host element, such as ICI element 601-0 is extended over 

read or write requests concurrently. The ICI elements path 602-0 and through ICC element 603-0 io the CH- 

comprise an interface which operates under control of ADT bus 604-0. This bus extends to IBC element 609-0 

microprocessors 608 and 613 to interconnect one of the as well as to cache memory 512. The IBC element 609-0 

two left-side channel ports of an ICI element with one 10 is subsequently described in detail and it comprises a 

of its two right side ports to control busses 606-0 and bi-directional switching element which can connect 

606-1. A read or write request received by an ICI ele- either of its two left-side ports with its right-side port, 

ment, such as 601-0 of cluster 501 on path 134-10, may The right-side port connects to CTL-I path 108-0 which 

be extended to ICC element 603-0 via path 602-0 of the extends to disk controller 112. On its left side, the IBC 

upper portion of the storage cluster or may be extended 15 element is connected on its upper port via the CH-ADT 

over path 602-1 to ICC element 603-1 of the lower path 604-0 to ICC element 603-0. The IBC element 

portion of storage cluster 501. The ICI elements are 609-0 is connected by its lower left port to the DEV- 

connected over either control bus 606-0 to micro- ADT path 611-0 extending to cache memory 512. 

processor 608-0 and is further connected via control bus The ID1 elements 614-0 and 614-1 are subsequently 

606-1 to microprocessor 608-1. 20 described in detail and comprise intelligent electrical to 

Each ICI interface element 601, in conjunction with optical interfaces that permit cache memory 512 to 

microprocessors 508 or 613, facilitates communication transmit data over paths 616 and optical data links 106 

of DSC 105 with a host channel, such as 123, to accept to DSC 107 on operations in which extended dual copy 

selection, transfer of channel commands to DSC 105, service is required. The IDI elements 614 are connected 

transfer of status from DSC 105 to a channel and trans- 25 to remote control busses (RC) 612. 

fer of data in either direction as is well-known in DASD The ICA elements 607 are bi-directional and connect 

systems. DSC 105 also sends commands to disk control- to control busses 606 to convert the timing and control 

ler 112 to concurrently move DASD actuator mecha- pulses on control busses 606 to the timing and control 

nisms (seek), initialize each of the DASDs to compare a pulses required to operate cache memory 512 and IDI 

required sector against the actual sector currently under 30 elements 614. These converted pulses are applied by 

the DASD actuator (set SECTOR), read any of the each ICA element 607 over its associated RC path 612 

count, key or data fields (where such architecture is to cache memory 512 and IDI elements 614. The SM 

implemented) or other fixed-length fields, where fixed elements 612 and 613 are memories that are shared 

block architecture is implemented. DSC 105 also in- jointly between the microprocessors 608-0 and 608-1 

eludes capabilities to compare the contents of a field 35 and microprocessors 613-0 and 613-1 in cluster 507. 

read from a disk unit 109 against data received from a These interconnections permit memories 612 and 613 to 

channel and to respond with low, equal, or high status. share memory information with both the upper and 

Data transfer is accomplished by first moving a DASD lower portions of storage cluster 501 and cluster 507. 

actuator to the desired track and then waiting for a The lower portion of storage cluster 501 comprises an 

pre-defined sector to occur under the head. The data 40 ICC element 603-1, an IBC element 609-1, and an ICA 

transfer path is normally disconnected while these oper- element 607-1 with each such element being identical in 

ations go on and reconnected at their conclusion while function to that already described for the correspond- 

being free to effect other operations. Following this, a ingly designated elements on the upper portion of stor- 

count field is read from the disk unit. Data from this age cluster 501. Similarly, storage cluster 507, which is 

count field is then compared with the data from a chan- 45 shown only diagrammatically, contains elements identi- 

nel and when the comparison is satisfied, the following cal to those shown in detail for storage cluster 501. The 

field may be written on the record. If the operation is a connections extending from storage cluster 507 to cache 

READ (as dictated by a read command from a chan- memory 512 permit cache memory 512 to serve the 

nel), data is read from the appropriate disk drive and is elements of storage cluster 507 as well as those of stor- 

eventually presented on a channel. If the operation is a 50 age cluster 501. 

write, data is received from the channel, stored in DSC The elements shown in detail on FIGS. 6 through 8 

105 and then presented to the appropriate disk drive 109 to permit DSC 105 to perform many read and write 

via the disk controller 112. DASD functions in a manner comparable to the IBM 

Busses 602-0 and 602-1 on the right side of ICI ele- Model 3990 storage control unit. Thus, the system of 

ments 601 are connected to the left side of ICC elements 55 FIGS. 6 through 8 can perform DASD fast write opera- 

603-0 and 603- L The ICC elements are primarily re- tions which improve the storage subsystem perfor- 

sponsible for implementing the DASD data streaming mance because immediate access to the disk units 109 is 

function and protocol. This function is well-known and not required for write hits and for full -track format 

is described in IBM publication GA22-6974-09, File No. writes. A DASD fast write operation stores the re- 

S360/S370-19 entitled "IBM System/360 & System/370 60 ceived data simultaneously in the VS portion 521 of 

I/O Interface Channel to Control Unit Original Equip- cache 312 as well as in NVS cache portion 520. Access 

ment Manufacturers* Information." This ICC element to disk drives 109 is not required to complete a DASD 

monitors the data flow to and from the channels and the fast write operation for write hits. Because a copy of the 

adherence of the data flow to required protocols. As record data is written to NVS 520, DSC 105 returns 

long as the data flow meets the protocol requirements, 65 channel end and device end status signals to the host at 

the ICC element is essentially invisible to the data flow the end of the data transfer to VS 521 and NVS 520. 

insofar as the present invention is concerned. The ICC This allows the host program to continue processing 

element is functionally operative only in the event that without waiting for the data to be written to disk drives 
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109. The data remains in VS 521 and in the NVS 520 on that track are then read from the cache memory and 
until the data is subsequently written to disk drives 109 are read hits. 

to free space in the VS or the NVS. Most write opera- The extended dual copy feature of the present inven- 
tions write directly to the cache memory 512 without tion provides a number of important advantages over 
going to the disk drives 109. This results in the same 5 known DASD systems. It protects data record avail- 
operational performance as does a read hit operation. ability on a critical volume from a single device failure 
On DASD fast-write operations, the information is by causing the concurrent writing of the data records to 
received from a host, such as host 121 over path 134-10, separate devices of separate subsystems. Data transfer 
and is extended through ICI element 601-0 and ICC operations arc switched to a secondary device on the 
element 603-0. From there, it is extended over CH- 10 other subsystem if a failure occurs of a primary device. 
ADT path 604-0 directly to cache memory 512. The The switching is transparent to the application pro- 
cache memory 512 writes the information into VS 521 gram. It provides for near continuous operations by 
and NVS 520. Subsequently, when the information is to providing a back-up copy if access is lost to one of the 
be written to a disk drive 109, the information is read dual copy devices. Lastly it ensures that a second copy 
out of the cache on path 611-0, extended through IBC 15 is always available that is identical to the primary. The 
element 609-0, and applied over CTL-I path 108-0 to status of the extended dual copy operation is kept in the 
disk controller 112 which causes the information to be SM 612. Extended dual copy is activated or deactivated 
written to one of the disk drives 109. If the system is by a host system command sequence. Using the ex- 
unable to write data from the cache memory, the copy tended dual copy feature requires no modifications to 
in NVS portion 520 of the cache is used to destage the 20 access methods or applications. 

data. DASD fast write operations allow fast write hits The two disk drives involved on an extended dual 
and preserve data integrity and availability by maintain- copy operation are termed a duplex pair comprising a 
ing two copies of all data modifications. One copy is in local device and a remote device. The extended dual 
VS 521 while the other is in NVS 520. copy operation is managed by the subsystem. All 1/0 

The system of FIGS. 6 through 8 permits data to be 25 operations are directed to the local volume. The system 
transferred between a channel and cache 512, between a automatically updates both copies of the data. Data is 
channel and a disk drive 109 and between a disk drive accessed from the remote disk drive only if the local 
109 and the cache. Data can be transferred from a disk disk drive or DSC is not available. The duplex pair is 
drive 109 to a channel at the same time the data is writ- established by host system commands. The remote 
ten to the cache. Data transferred from a channel to a 30 drive is automatically synchronized with the local drive 
disk drive 109 may also be transferred to the cache. when both volumes remain available to the subsystem. 
Data can also be transferred between the cache and a Because the remote drive is offline, the processor knows 
channel and between the cache and a disk drive 109 at of only one device— the local drive. The write opera- 
the same time. Data transfers to the cache can also go to tion to the remote device is transparent to the host. The 
the NVS 520 at the same time. Data transfers are made 35 DASD fast write capability can be applied to the ex- 
from the NVS 520 to disk drives 109 for error and data tended dual copy capability to produce an extended fast 
recovery conditions only. dual copy capability. This results in an optimum of data 

If a copy of a data record is in cache memory 512 availability, performance and reliability, 
when the channel initiates a basic write caching write With regard to extended dual copy operations and 
request (write hit), DSC 105 writes the data directly to 40 the system of FIGS. 6 through 8, let it be assumed that 
a disk drive 109 at the same time writes the data into the a user has transmitted system commands to storage 
cache memory. The record in the cache is updated cluster 501 to prepare it for the establishment of ex- 
because it may be referred to again. However, before tended dual copy service for a specified volume 109. 
DSC 105 can signal the operation as complete to the These commands are received by microprocessor 608-0 
channel, it must ensure that the record has been success- 45 of storage cluster 501 which, working with the shared 
fully written to the disk drive. The record is simuha- memory 612, effects the system operation so that all 
neously written to the cache and to the disk drive with subsequent write requests to this specified volume are 
the device-end signal returned at completion. This is an processed on an extended dual copy basis. Subse- 
example of branching data transfers. Writing to the disk quently, when a record write request is received for the 
drive provides data integrity because copies in the 50 specified volume, the record is written to the disk drive 
cache memory and the disk drive are identical. When a in each of DSCs 105 and 107 serving the specified vol- 
record being updated is not found in the cache memory, ume. Let it be assumed that the record for the subse- 
the condition is termed a write miss and the record is quent request is written to disk drive 109-n. At the same 
written directly to the disk drive and not written to the time, cache memory 512 and microprocessor 608 work- 
cache memory. 55 mg together cause a copy of the record to be applied 
The system of FIGS, 6 through 8 also processes read over one of paths 616 and one of IDI elements 614 for 
requests in which the requested record is not in the transmission over one of optical data links 106 to DSC 
cache (read misses) as well as read requests for which 107. This received record is entered by DSC 107 into its 
the requested record is in the cache (read hits). If a copy cache memory. From there it is applied via its IBC 
of the data is in the cache when the host processor 60 element 609 to its disk controller 113 for writing on the 
initiates a read request, DSC 105 transfers the desired disk drive 111 which has been designated as the remote 
data from the cache to the host via CH-ADT path 604-0 unit of the duplex pair designated for extended dual 
and the channel. If a copy of the data is not in the cache, copy service. A duplicate copy of the record is written 
DSC 105 sends the requested data directly to the chan- on this particular disk drive 111 and following this oper- 
nel from the disk drive and at the same time writes the 65 ation, DSC 107 transmits an acknowledgment message 
data (plus the rest of the data from that record to the back over one of the optical links 106 to DSC 105 advis- 
end of the track) into the cache memory in anticipation ing it that the duplicate copy of the record has been 
of future use. Subsequent requests for following records recorded on a disk drive 111. Following the receipt of 
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this acknowledgment on extended dual copy write op- Control busses 606-0 and 606-1 provide the communi- 

erations, DSC 105 returns a signal to the channel that cation path between microprocessor and other elements 

the extended dual copy write operation has been com- of DSC 105. Registers of elements connected to busses 

pleted. For extended fast dual copy write operations. 606 are memory mapped into the microprocessor 608 

the completion signal is returned to the channel when 5 address space. When these registers are accessed, the 

the record is received and acknowledged by the cache microprocessor bus cycle is held pending by inserting 

of the remote DSC r „ , wait cycles until the bus is granted and the data transfer 

The IBC element on FIG. 10 includes a full track ^ completed 

buffer 1005 that can store the entire contents of a disk The cache memory subsystem consists of all the ele- 

dnve track as well as control information. The IBC 10 Mne ^ topcrfonnhj h d ^ d 

element is accused at its frontend by CH-ADT bus xe(ricvaJ op J^ nqM The^cache controls read 

^ in, rf X T '"I J** ** d write operations to VS 521 or NVS 520. It has an 
ADT interfaces 1003 and 1004 and the device interface • . . »l « »-r *l 

1013 contain control logic that manipulates data streams mtmapi «T ^ not ^ , the a PP">P n * le ™oc 
that pass through the interfaces so ai to meet count key " pr0C ^°/ W jl Cn * ^ subsvstci " cvcnt »- 
data format requirements. The function of the IBC T C * !t f *f ^ f ope«t«m. tl»i test the function- 
element is controlled by microprocessor 608 over path °[ the cxtc ™l ,ntcrfac ^ the ««*nial busses, and 
606-0 which instructs the IBC element to configure crror dctec V° 1 n reporting logic. It has a perfor- 
itself and initiate data transfers. Information that the m ? lce "P**" 1 ^ th4t monitors and reports when the 
IBC element uses for configuring itself is stored in the 20 wajls r ° r cachc resources and a field replace- 
full track buffer 1005. able uml identification mechanism that permits the mi- 
The full track buffer 1005 is used for manipulating coprocessor to determine the size and configuration of 
count key and data (CKD) fields as they pass through thc voIat ik non-volatile memory, 
the IBC during synchronous data transfers. Micro- ^IG 11— IDI Element 
processor 605 writes and reads information from all 

registers of the IBC element. FIG - 11 discloses further details of IDI element 614 

Three ports comprise the data path through the IBC of FIG. 8. The connections to the IDI element of FIG. 

element. At the right side is the control interface H are designated in the manner to facilitate their corre- 

(CTL-I port) which connects to one or more disk con- 30 spondence with the IDI element of FIG. 8. Data bus 

trollers 112. On the left side is the port to CH-ADT bus 61<w> on FIG. 11 corresponds to the like designated 

604-0. The DEV-ADT port is connected over path element on FIG. 8 and extends to cache memory 512. 

611-0 to cache memory 512. Similarly, the optical data link conductors have a group 

The IBC element operates in two different modes. In designation of 106-0 with the individual paths of this 

a first mode, microprocessor 508 has read/ write access 35 group being designated as 1, 2, 3 and 4. The RC conduc- 

to all registers within the IBC element and to the data tors designated 612-0 and 612-1 of FIG. 8 extend on 
stored within buffer 1005. In this mode, drivers 1003, " FIG. 11 to control element 1105. 

1004 and 1013 are disabled by allowing the micro- The IDI element of FIG. 11 further comprises a 

processor to run diagnostics internal to the IBC element packetizer 1101, a de-packetizer 1102, a second packe- 

without disturbing other hardware electrically con- ^ tizer 1103 and a second de-packetizer 1104. Conductors 

nected to the IBC. The microprocessor 608 also uses mi through 1114 interconnect control element 1105 

this mode to prepare the IBC element for synchronous with thc packers ^ de-packetizer elements. Packe- 

data transfers. tizcr 1,01 operates under control of control element 

After microprocessor 608 has prepared the IBC ele- H05 md reccjvcs daU si ^ ovcr dflU h 61M , 

mem for a synchronous data transfer ,t places the IBC 45 ^ si [s afC mwXc6 t0 a ^eiiicd format and 

element in the run mode. Control of the data transfer is . f e , ^Vv i „r *ru « ! 

then maintained by the buffer stage controller 1011. ? h mi ovcr ^ h 1 of Kroup 1WW> to 

Controller 1011 monitors the data Transfer and causes * e p clcmcm "J? • d ^P^kct.zer 

stage transitions to occur as the data transfer progresses. XhtTCm ° f M0 * cr DSC 6cto t 1103 thc 

These stage transitions are necessary to support the 50 ttne "T' ,f rCCC,VCS ^ f 1 ?* ° n P"^ 61W *. " 
CKD format. converts them to a packetized format and transmits 

Memories 612 are shared by microprocessors 608 and tbcm ovcr P* th 3 of * rou P 106 *° to ■ de-packetizer in a 
613 within DSC 105. The memories may be 512 k by 36 corresponding IDI element of the other DSC. De- 
bits, arranged as four 8-bil bytes with parity. There are packetizers 1102 and 1104 receive the packetized opti- 
two shared memories (612-0 and 612-1 in DSC 105. 55 cal signals on paths 2 and 4, respectively, of group 106^) 
Redundancy is achieved by writing and reading simul- convert these signals to a standard data format and 
taneously over two separate busses with the same data. a PP lv converted signals to paths 616-02 and 616-04 

The shared memory 612 is memory mapped and con- °^ Dus $16-0. 

' trol exists to enable the use of one or both of the shared E** packetizer/de-packetizer pair such as elements 

memory busses 630 and 631. When reading, the data on 60 Mcl 1M*2 can handle a bi-directional data commu- 

both busses 630 and 631 is compared and an error is ni cation. The two packetizers and the two de-packetiz- 

posted if a mismatch is detected. Microprocessor 508 ers shown on FIG. 11 permit data link 106-0 simulta- 

performs the DSC 105 control functions. It consists of a neousJy to handle two independent data communica- 

dual commercial AMD 29000 processor, processor tions between the pair of DSCs interconnected by data 

program and data memories, a shared memory inter- 65 link 106-0. The packetizers and de-packetizers on FIG. 

face, a local control bus interface, a maintenance inter- 11 include the necessary facilities, such as optica] driv- 

face and interrupt controller, a timer, and error check- ers and receivers, to communicate with optica) paths 

ing and status logic. 106. 
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Description of Channel Commands 

The following describes the manner in which the 
system of the present invention, in particular DSC 105, 
responds to the reception from the host of unconven- 
tional channel program commands which are used to 
manage extended dual copy service. DASD channel 
program commands are well-known and are described 
in detail in Chapter 4 of an IBM publication GA 
32-0099-3 entitled IBM 3990 Storage Control Refer- 
ence, Fourth Edition (December 1989). The channel, 
such as 123-0, receives a start subchannel instruction 
from the host to start a channel program and then fet- 
ches a channel address word (CAW) for the program 
which is a four-byte word located in main storage of the 
host. The CAW contains the address of the first channel 
command word (CCW) in the chain of CC Ws compris- 
ing the channel program which is located in the host 
memory. The channel responds to the start subchannel 



croproccssor 608-0 and its shared memory 612 for pro- 
cessing and storage within memory 612. The ICC ele- 
ment 603-0 performs a data streaming function which is 
fully described in chapter 3 of the referenced IBM pub- 
5 lication and need not be described in further detail 
herein. 

DASD write requests are conventionally established 
by the transmission over the channel of a DEFINE 
EXTENT command followed by a LOCATE RE- 
10 CORD command followed by a WRITE command. 
The DEFINE EXTENT command performs a number 
of functions the main one of which is to define limits on 
operations which follow in the same channel program. 
The LOCATE RECORD command causes the head to 
15 be positioned to a specified cylinder, track, and sector 
number. The LOCATE RECORD command also 
causes the subsystem to search for a specified record 
starting with the specified sector. The WRITE com- 
mand causes the specified disk drive to write the data 



instruction and fetches the first CCW of the channel 20 transmitted immediately following the WRITE com- 
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program from the address specified by the CAW. A 
CCW is eight bytes in length. One byte is an operation 
code that identifies the specified command. Three bytes 
specify the memory address of an associated parameter 
list or information involved in the operation. 

After receiving the first CCW, the channel selects a 
specific peripheral storage device such as a particular 
disk drive 109, by sending the device address to DSC 
105. If the selected disk drive 109 is available, the com- 
mand code for the first CCW is sent to DSC 105 which 
returns an initial status byte to the channel indicating 
that the specified disk drive is available. If the selected 
device 109 indicates busy in the initial status byte, a 
signal is sent to the host indicating this and the com- 
mand is issued again by the host a short time later. DSC 35 
105 can execute a series of CCWs from a single start 
subchannel instruction by the activation of a flag bit in 
each CCW. This function is referred to as command 
chaining and is well-known. This function is also de- 
scribed in IBM document No. SA22-7085 entitled 
"IBM System/370 Extended Architecture Principles of 
Operation.*' 

A path such as path 134-10 interconnects channel 
123-0 with interface circuit ICI element 601-0. This path 
comprises an I/O interface path and it is described in 
detail in IBM publication GA 22-6974-09 entitled, 
"IBM System/360 and System/370 I/O Interface Chan- 
nel to Control Unit Original Equipment Manufacturer's 
Information," 10th ed. (February 1988),© Interna- 
tional Business Machine Corporations 1987. This publi- 
cation discloses in detail the specific conductors that 
comprise an interface path such as 134-10. It further 
describes the details of the signals that are transmitted 
over the path conductors to control the DASD opera- 
tions when information is written to and read from the 
disk drives. Since these details are well-known and are 
described fully in the aforementioned IBM publication, 
they are not set forth herein. 

In a well-known manner, element ICI 601-0 and DSC 



mand to the disk drive. A read operation from a disk 
drive is controlled by the sequential transmission of a 
DEFINE EXTENT command, a LOCATE RECORD 
command and a READ command. 

The DEFINE EXTENT command and the LO- 
CATE RECORD command are each associated with a 
block of data comprising a parameter list which speci- 
fies information required by the DASD system to effect 
the system operation associated with each command. 
The parameter list for each command is transmitted to 
the DASD subsystem immediately following the chan- 
nel command. The full sequence of channel commands 
and associated parameters and data transmitted on an 
exemplary DASD subsystem operation is: 
DEFINE EXTENT command 

DEFINE EXTENT Parameter List 
LOCATE RECORD command 

LOCATE RECORD Parameter List 
WRITE DATA command 
DATA to be transmitted 
READ COUNT KEY DATA 
DATA that is read 
FIG. 14 discloses a standard DASD channel program 
that writes the data field of a specified record of a speci- 
fied disk drive and subsequently reads the count, key, 
and data fields of the record which immediately follows 
the record just updated. The program begins on line 1 
when a channel address word (CAW) is fetched by the 
host channel. One field of this CAW is a pointer 1400 to 
50 the memory location of the first channel command 
word (CCW) (line 2) of the program. The fetching of 
the CAW of line 1 causes the channel program to start 
with the DEFINE EXTENT command of line 2. The 
format of the channel program command words is 
55 shown in lines 2-5 of FIG. 14. The left-most field com- 
prises the operation code, the neit field is a command 
chaining flag field (CCFL). Next is the count field; the 
right-most field is the data address field which is a 
pointer to the memory address of the parameter list or 
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10S determine that a specified disk drive such as 10S-5 is 60 data associated with the command. The DEFINE EX- 



available and they return a signal back over interface 
path 134-10 to channel 1234) indicating that the disk 
drive 109-5 is available. Having received this return 
signal, the host processor and the channel 1234) cause 
the series of CCW commands about to be described to 65 
be transmitted over interface path 134-10 to ICI element 
601-1 of DSC 105. Each command received by an ICI 
element is extended through ICC element 603-0 to mi- 



TENT command of line 2 has an operation code of DX, 
a CCFL flag of 1 indicating that this command is not 
the last command of the channel program. The count 
field is 16 indicating the number of bytes in the DE- 
FINE EXTENT Parameter List of line 6. The data 
address field contains the memory address location of 
the first byte of the DEFINE EXTENT Parameter List 
of line 6. This DEFINE EXTENT Parameter List is 
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shown in line 6 with pointer 1401 indicating the rela- 
tionship between the data address Held of the DEFINE 
EXTENT command of line 2 and the address of the 
beginning byte of the DEFINE EXTENT Parameter 
List of line 6. 5 

The DEFINE EXTENT command of line 2 is first 
sent to the DASD subsystem of FIGS. 6 through 8 and 
the DEFINE EXTENT Parameter List is next sent. 
The receipt of the DEFINE EXTENT command of 
line 2 and the DEFINE EXTENT Parameter List of 10 
line 6 causes the DASD system to perform the well- 
known system operations specified by the information 
of lines 2 and 6. Next, the LOCATE RECORD com- 
mand of line 3 is sent to the DASD subsystem and 
immediately thereafter the LOCATE RECORD Pa- 
rameter List of line 7 is sent. The DASD subsystem 
then effects the system operations associated with this 
information. 

Next, the WRITE DATA command of line 4 is sent 
to the DASD subsystem and is followed by the data that 
is to be written which is symbolically shown in line 8. 
As subsequently described, and for other uses, the infor- 
mation of line 8 is termed a "REQUEST PACKET." 
The host next causes the READ COUNT KEY DATA 
command of line 5 to be transmitted to the DASD sub- 
system which then reads the count, key, and data fields 
of the next record on the same track and transmits this 
data of line 9 to the host. For other uses, the information 
of line 9 is termed a "RESPONSE PACKET." The 
foregoing describes how the host employs conventional 
DASD IBM 3990 channel program commands to cause 
data to be written and read by DSC 105. 

In accordance with the present invention, the host 
processor transmits a sequence of channel commands 35 
similar to that shown on FIG. 14 in order to instruct the 
DASD system to prepare itself for the provision of 
extended dual copy service to specified disk drives. For 
this extended dual copy service, the host transmits a 
sequence of channel commands comprising DEFINE 
EXTENT, LOCATE RECORD and WRITE DATA 
to the DASD system together with a parameter list 
and/or data for each such command. The transmitted 
parameter lists contents differ in specific ways from the 
aforementioned standard DASD commands, parameter 45 
lists and data. In order to prepare the system for the 
provision of extended dual copy service, the host trans- 
mits a series of channel commands comprising the DE- 
FINE EXTENT command of line 2 of FIG. 14 fol- 
lowed by a DEFINE EXTENT Parameter List which 50 
is similar to that of line 6 of FIG. 14 but whose details 
are shown on FIG. 15. Next transmitted is the LO- 
CATE RECORD command of line 3 of FIG. 14 fol- 
lowed by a LOCATE RECORD Parameter List simi- 
lar to line 7 of FIG. 14 but whose details are shown on 55 
FIG. 16. Next transmitted is the WRITE DATA com- 
mand of line 4 of FIG. 14 followed by a block of infor- 
mation similar to that of line 8 of FIG. 14 but which is 
interpreted by DSC 105 as a Request packet and whose 
details are shown on FIG. 17. go 
DSC 105 interprets the reception of the 
commands and information of FIGS. 14-17 as being a 
request from the host to prepare itself for the provision 
of extended dual copy service to a pair of specified 
volumes when the above-described standard DASD 65 
channel commands are subsequently received request- 
ing the writing of a data record to the locally specified 
volume of DSC 105. 
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In the following description of FIGS. 15-17, the 
hexadecimal notation is indicated by a symbol such as 
X'9C containing an X and two primes. With regard to 
the DEFINE EXTENT Parameter List of FIG. 15. the 
following Table II on page 11 of the aforementioned 
IBM 3990 Storage Control Reference publication speci- 
fies the format of the information represented by each 
field and the number of bytes comprising the size of 
each field. 

TABLE 11 



Field 0 



Define Eiien 1 Command Pat line I en 
Byte Parameter 



0 Mask byte 

1 Global attributes 
2-3 Block size in bytes 
4-5 Cache fast write ID 

6 Reserved, must be zero 

7 Not used 

I Beginning of extent address 

12-15 End of extent address 



Beginning on the left-most field and proceeding to the 
right on FIG. 15, the DEFINE EXTENT Parameter 
List transmitted by the host for the establishment of 
extended dual copy service comprises an X'9C' in the 
MB field 0. an X'E4' in the GA field 1, 0s in the BLS 
field 2, Os in the CFWID field 3, Qs in fields 4 and 5, the 
beginning extent address (BEX-ADD) of the CE cylin- 
der in field 6 and the end of the extent address (EEX- 
ADD) of the CE cylinder in field 7. 

The details of the LOCATE RECORD Parameter 
List transmitted for the establishment of extended dual 
copy service are shown on FIG. 16. The following table 
12 on page 72 of the last-mentioned IBM publication 
discloses the format of the fields of the LOCATE RE- 
CORD Parameter List for conventional DASD sys- 
tems. 

TABLE 12 



Locate Record Parameters 
Fwld I* Byte Parameter Name 



0 
1 
2 
3 

4-7 

8-12 
13 

14-15 



Ope ration byte 
Auxiliary byte 
Reserved, must be zero 
Count 

Seek address 
Search argument 
Sector number 
Transfer length factor 



FIG. 16 shows the contents of the LOCATE RE- 
CORD Parameter List transmitted for the present in- 
vention. The OB field 0 contains X'01*. The AB field 1 
contains X'OO'. Field 2 contains a 0. The COUNT field 

3 contains X'01*. The SEEK ADDRESS (SADD) field 

4 contains the address of the CE cylinder. The 
SEARCH ARGUMENT (SARG) field 5 contains 
X'C5C3C1D4FF' which is considered invalid by con- 
ventional DASD subsystems. The SECTOR NUM- 
BER (S#) field 6 contains X'OO', the TRANSFER 
FACTOR (TLF) field 7 contains X'FFFF. 

The details of the information block of line 8 of FIG. 
14 is termed a Request packet when transmitted for the 
establishment of extended dual copy service and is 
shown on FIG. 17 and is transmitted to DSC 105. The 
MSG ID field 0 of the Request packet of FIG. X3 con- 
tains MECG 5 which stands for Manage Extended 
Copy Group. The REQUEST TYPE field 1 contains 
ESTB which stands for Establish Extended Dual Copy 
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Service. The LV (local volume) field 2 contains a 3 port an error condition back to the host since certain of 
indicating that disk drive 3 associated with DSC 105 is the contents of certain fields of FIG. 16 violate standard 
lo provide extended dual copy service. The RV (remote DASD conventions even though they are in host- 
volume) field 3a contains a 1 indicating that disk drive acceptable command format. It should also be appreci- 
1 of remote DSC 107 is to be paired with disk drive 3 of 3 ated that although the channel commands transmitted 
local DSC 105 for the provision of extended dual copy to the DASD subsystem of the present invention con- 
service by this pair of disk drives. The function of fields tain information illogical to a standard DASD subsys- 
3/ through $n arc later described. The MESSAGE tern, that once extended dual copy service is set up 
COMPLETION STATUS Held 4 specifies the status of within DSC 105 by the aforementioned special DASD 
the completion of this request. It alternatively indicates 10 channel program, that standard DASD channel corn- 
either that the request was executed successfully or mands are subsequently used to control the writing and 
identifies a system trouble if it was not executed success- reading of data to the volumes specified for extended 
fully. dual copy service. 

The above-described transmission of the channel In response to the receipt of the above-described 
program commands of lines 2, 3 and 4 of FIG. 14 and 1 5 write data command that contains the "manage ex- 
the associated parameter lists of FIGS. 15, 16, and the tended copy group message 0 with the function code of 
request packet of FIG. 17 by the host causes DSC 105 establish an extended copy group (FIG. 17), the subsys- 
to take the preparatory system actions required for the tern validates the parameters of the received commands, 
subsequent furnishing of extended dual copy service by validates the state of the devices specified by the corn- 
local disk drive 3 and remote disk drive 1. Although the 20 mands and determines that it is legal to establish an 
transmitted channel commands and parameter lists and extended copy group consisting of the two identified 
request packet are similar to those used in conventional volumes (local volume 3 and remote volume 1). When 
DASD subsystems for a write operation, the contents of the validation is successful, DSC 105 begins the asyn- 
the parameter lists of FIGS. 15 and 16 and the data chronous process that causes the current contents of 
block of FIG. 17 differ from those of standard DASD 25 local volume 3 to be copied to remote volume 1. When 
systems so that the combined receipt of the information that process begins, but before it is completed, the local 
shown on FIGS. 14-17 advises DSC 105 that this is not DSC 105 responds to the read count-key data command 
a standard request for execution of a conventional of line 5 of FIG. 14 in the channel program with a 
DASD write operation but, instead, is a request for the response packet and an ending status signal to the host, 
provision of extended dual copy service for local vol- 50 The message completion status of this response packet 
ume 3 paired with remote volume 1. Upon the subse- normally indicates to the host that the request has been 
quent receipt of a standard DASD write request speci- accepted and that the process of making volumes 3 and 
fying local volume 3, the record associated with this 1 identical has been initiated successfully. If anything is 
standard write request is written on both local volume 3 found to be invalid concerning this request or if the 
of DSC 105 and on remote disk drive 1 of DSC 107. The 35 process of making volumes 3 and 1 identical cannot be 
above-described commands are followed by a Read initialed successfully, for example, because a data link 
Count Key Data command of line 5 of FIG. 14 which 106 is not available, then instead of responding to the 
causes DSC 105 to return a Response packet informa- read count-key data command with a response packet 
tion block of line 9 of FIG. 14. indicating a successful initiation of the command, the 

DSC 105 is now prepared to provide extended dual 40 DSC 105 responds to the host with a response packet 
copy service on subsequent write requests received indicating what exactly is the problem by the contents 
from the host specifying local disk drive 3. Subse- of the message completion status field, 
quently, the host next transmits to DSC 105 the stan- At this point extended dual copy service is estab- 
dard DASD program CCWs shown on FIG. 14 to lished within DSC 105. DSC 105 may then receive 
cause a record to be written by both volume 3 of DSC 45 subsequent write commands of the FIG. 14 type for all 
105 and remote volume 1 of DSC 107, As shown on of drives 109. The microprocessor 608 and the shared 
FIG. 14, this standard program comprises the following memory 612 look at the device address specified by 
command sequence: each such write command and perform in the well- 

The DEFINE EXTENT command of line 2, known manner to write the records if extended dual 

The DEFINE EXTENT Parameter List of line 6, 50 copy service has not been invoked on the drives speci- 
The LOCATE RECORD command of line 3, fied by these commands. In other words, subsequent 

The LOCATE RECORD Parameter List of line 7, write requests to volumes not requiring extended dual 
The WRITE DATA command of line 4, and copy service are processed in the normal way. 

The DATA to be transmitted of line 8. Subsequent write requests to a volume requiring ex- 

In response to the receipt of these channel program 55 tended dual copy service are processed by local DSC 
commands, DSC 105 causes the data of line 8 of FIG. 14 105, in the normal manner insofar as writing a record 
to be written into disk drive 3 of the local DSC 105 and written onto local volume 3. Let it be assumed that 
causes the same data to be written into disk drive 1 of DSC 105 has received commands which specify the 
remote DSC 107. writing of a record to specified cylinder on a volume for 

It should be appreciated from the foregoing that the 60 which extended dual copy service is to be provided, 
system of the present invention causes extended dual When DSC 105 receives that command, it executes it in 
copy service to be provided using standard DASD the well-known manner. The following describes what 
subsystem commands with the contents of certain fields DSC 105 does to transmit information over IDIs 614 
of the parameter lists of FIGS. 15, 16 and the request and the optical data links 106 to DSC 107 to cause it to 
packet of FIG. 17 being different from that of a stan- 65 generate an extended dual copy at the mated disk unit 
dard DASD write operation. The transmission of the (volume 1) in DSC 107. 

channel program of FIGS. 14-17 to a standard DASD The way things generally work is that while the sys- 
subsystem would cause the standard subsystem to re- iem is in the process of writing a modified data record 
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onto the local disk device, a copy of the record is made particular virtual volume. The reason such a lock must 

in cache 512 of DSC 105. This copy of the modified exist is because only one of the DSCs at any one time 

record is transmitted over optical data link 106 to the may have the current responsibility for knowing exactly 

cache of DSC 107, The request to write that modified what the most recently updated state of the virtual 

record onto the remote volume of the extended dual 5 volume is. That is to say, either of the two DSCs may 

copy pair is transmitted in advance of the modified data from time to time receive and process requests from 

record. The remote disk control unit then writes the hosts attached to either of the two DSC units to write 

modified record from the cache of DSC 107 onto a disk an update onto the virtual volume which is realized by 

111 of DSC 107. When the writing process is complete, the extended copy group. In order to write, it is neces- 

DSC 107 reports back over data link 106 to DSC 105 10 sary that the DSC that's going to write to the volume 

that the remote copy has been updated by DSC 107. own the responsibility for the integrity of the volume 

That's the high-level view of one of the alternative during the write process. lt*s therefore necessary that 

ways that the system operates. This alternative that has the DSC that received the write request know that the 

just been described is termed extended dual copy. Next other DSC is not at the same time also trying to write 

described is extended fast dual copy. 15 the same volume. So the first DSC has to obtain an 

In extended fast dual copy, the record received by extended copy group lock that is passed back and forth 
DSC 105 from the host is not immediately written to between the two DSCs upon the request of either one of 
local disk drive 109. Instead, it is only retained in cache them when the two DSCs require access to the volume. 
512 of local DSC 105. This record is in both the VS and Not only is it necessary that this lock be owned by a 
NVS portions of cache 512. The modified record is also 20 DSC in order for it to provide write access to the vol- 
transmitted over data link 106 to the cache of remote ume, but it is also necessary that a DSC own the lock in 
DSC 107 and is stored in its NV store. When the modi- order to provide read access. The reason that this is 
fied record has been stored in the NV store of remote necessary is because if the local DSC did not own the 
DSC 107, that fact and the completion status of that lock, and the remote DSC were in the process of writ- 
storing is sent back over data link 106 to local DSC 105. 25 ing to the virtual volume, the local DSC could report to 
When local DSC 105 is informed that the modified the host that was attempting to read this record while 
record has been written successfully to both its own the remote DSC was trying to write the record. In that 
cache 512 and its own local NV store and also to the case, the local DSC would read the old version of that 
remote NV store by the remote DSC 107, then local record while the host would have written an updated 
DSC 105 reports to the host that the modified record 30 version of the record using the remote DSC and the 
has been successfully received by both disk subsystems. update may not yet have been processed by the local 
The disk subsystems are then responsible for processing DSC. In order to avoid that data integrity exposure, the 
the received modified record. What this responsibility extended copy group lock must be held by a DSC when 
entails after having released the host, is the process of that DSC is processing either a read or a write request 
subsequently writing the modified record from cache 35 from a host against the particular virtual volume. This is 
512 of local DSC 105 onto the appropriate disk drive further described in detail on subsequent pages. 
109 of the extended dual copy group and also the writ- Next described is what happens when a host is at- 
ing from the cache of the remote DSC 107 onto the tempting to read a record from the virtual volume that's 
appropriate one of a disk drive 111 which is the other implemented by an extended dual copy pair and some- 
member of the extended copy group pair of disk drives. 40 thing is inoperable. There are several possible cases of 
When all of that has been completed, then all of the that. The first case described is where the thing that is 
actions that must be taken to comply with the host inoperable is the physical disk drive of the local DSC 
request to update the record have been accomplished. the host is trying to read from. FIG. 1 shows two DSCs 

Next described is how the system of the invention and one host. Normally the reads coming into DSC 105 
executes read commands with everything working 45 on FIG. 1 would be processed through the appropriate 
properly. When DSC 105 receives a read request it is one of disk drives 109. However, assume that the in- 
necessary to understand whether the most current volved one of disk drives 109 is inoperable and is not 
image of the virtual volume that has an extended dual available. Any number of problems could have made it 
copy implementation is contained within DSC 105 that impossible for DSC 105 to read the record that host 
received the read request or whether the most current 50 wants to read off of the appropriate ones of disk drives 
image of thai virtual volume is actually contained in 109. In any of these cases, DSC 105 determines that it 
remote DSC 107. The way that the most recent record can't read the record that the host wants from the ap- 
version could be contained in remote DSC 107 is if a propriate one of its disk drives 109. Rather than involve 
host attached directly to the remote DSC 107 were to the host in an' error recovery procedure of any sort, 
have recently written an update of the record to the 55 DSC 105 communicates over data link 106 to DSC 107 
virtual volume in the remote DSC 107. Then that up- that it wants to read the particular record that it 
date may be in the process of being applied by the re- couldn't read off of its local disk drive 109. In response 
mote DSC 107 over data link 106 to the DSC 105 unit to receiving this message over data link 106, DSC 107 
which now may be responding to a read request from reads from the appropriate one of disk drives 111 that is 
the host for the record that has been priorly updated by 60 the extended dual copy pair of the drive 109 that cannot 
the host to a volume of DSC 107. be read from. Assume the remote volume can be read. 

In order to proceed with integrity with the read, DSC 107 then transmits the record that is required by 

DSC 105 must ascertain whether or not it owns the the host back over data link 106 to DSC 105. Actually, 

extended device lock or tag associated with the ex- DSC 107 will not just transmit the one record that was 

tended copy group. In order for a DSC which has re- 65 asked for, but it transmits the entire track that contains 

ceived a read request from a host to be able to honor the record that has been asked for. That track is then 

that read request, that DSC must be in possession of a placed into cache 512 of DSC 105 as though it had been 

token called the extended copy group lock for that read from the appropriate one of disk drives 109. Host 
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101 is then given the data record from cache 512 of the group and is shown on FIG. 18 to be termed EX- 
DSC 105 without knowledge that the record could not TENDED DUAL COPY. Other possible services are 
be read from a disk drive 109. EXTENDED CONNECTIVITY and EXTENDED 

On FIG. 2, where the host is actually connected to MULTIPLE COPY. These are described elsewhere in 
both DSC 105 and 107, let it be assumed that one of disk 5 the present application. The LOCAL VOID field 3 
drives 109 is broken. It is possible that the host could be identifies the local volume that is associated with the 
asked to access the record over alternate channel path dual copy service and is shown to be 3 in FIG. 18. The 
104-1 and DSC 107 directly without involving DSC REMOTE VDID field 4 identifies the volume of DSC 
105. However, the present invention does not contem- 107 that is to be written to provide the extended dual 
plate doing it that way. Instead, if the record is readable 10 copy service. FIG. 18 shows this to be volume 1 of 
over data link 106, then DSC 105 will cause the record DSC 107. The GROUP STATE field 5 identifies the 
read by DSC 107 and transmitted over the data link 106 state of the system with respect to the provision of 
back to DSC 105. The host is then given the record extended dual copy service. FIG. 18 shows the state to 
over channel interface 104-0 without the host having to be designated as being ACTIVE. Other possible system 
further be involved in the error-recovery procedure. 15 states which are not shown in detail can be SIMPLEX, 
n . , v w PENDING, SUSPENDED, and CONDITIONAL, 

uaia Linx Messages The CYLINDER MAP LOCATION field 6 indicates 

The following describes the messages that are trans- which DSC contains the modified cylinder bit map for 
mined over data links 106 between the DSCs when the group. FIG. 18 shows this to be DSC 105. The 
extended dual copy service or extended multiple copy 20 OWNER ID field 7 indicates which DSC is the original 
service is to be provided. It has priori y been described owner of the extended group lock for the group. FIG. 
in connection with FIGS. 14 through 17 how com- 18 shows this to be DSC 105. The SYNC PACE field 
mands are transmitted from the host to a local DSC indicates the rate at which the volumes of the group are 
over a channel interface path, such as 134-10, to prepare to be synchronized. The term "synchronized" means 
local DSC 105 for the provision of extended dual copy 25 that the two volumes are to be written so as to be identi- 
service when one or more write requests are subse- caJ. The pace is shown to be RAPID on FIG. 18. The 
quently received directed to a priorly specified volume SYNC CKPT field 9 contains the CCHH address of the 
(disk drive) of the local DSC 105. When such write last track of the group which has been priorly synchro- 
requests are received, multiple copies of the record nixed. 

accompanying each write request are created by writ- 30 When local DSC 105 receives each request to write a 
ing one copy of the record on the specified volume of record onto a volume priorly identified for extended 
local DSC 105 and by writing another copy of the re- dual copy service, DSC 105 may not already own what 
cord on a volume of remote DSC 107. The remote is termed the "extended copy lock" for the volume. If it 
volume was originally specified in the does not own that lock, then it must request ownership 

channel program of FIGS. 14-17 that conditioned 35 of the lock from DSC 107 over data link 106. DSC 105 
local DSC 105 for the subsequent provision of extended does this by sending a REQUEST OWNERSHIP 
dual copy service. As shown on FIG. 17, it is assumed MESSAGE of FIG. 19 to DSC 107 identifying the 
that extended dual copy service is to be provided by group for which it wishes to receive the lock. When 
volume 3 of local DSC 105 and by volume 1 of remote DSC 107 receives the REQUEST OWNERSHIP mes- 
DSC 107. This service will be provided for all subse- 40 sage, and after it has finished the operations required of 
quently received record write requests directed to vol- it in response thereto, it responds by transmitting a 
ume 3 of DSC 105. GRANT OWNERSHIP message of FIG. 19 to DSC 

When each write data command is subsequently re- 105. At that time, local DSC 105 owns the extended 
ceived that is directed to volume 3 of DSC 105, the copy group lock for the group i.d. and it can proceed to 
command parameters are stored within microprocessor 45 cause a dual copy of the record to be written by local 
608 and the shared memory 612 of DSC 105. The data volume 3 and remote volume 1. 
comprising the record is applied over path 604-0 and The message that is sent from DSC 105 to request 
stored in cache memory 512. At that time, microproces- ownership of the lock is shown on FIG. 19 in general- 
sor 608 and shared memory 612, working together, ized form. Field 0 indicates various types of message, 
determine that the write request is directed to volume 3 50 The opcode for these messages can be SUSPEND or 
of DSC 105 and that DSC 105 U to cooperate with DSC TERMINATE or REQUEST OWNERSHIP or 
107 to provide extended dual copy service for the re- FORCE OWNERSHIP or GRANT OWNERSHIP, 
cord accompanying each such write request. Cache At this time, the opcode for the message transmitted by 
memory 512, microprocessor 608 and shared memory DSC 105 is REQUEST OWNERSHIP and the 
612 cooperate to cause the control messages and data 55 GROUP I.D. of field 1 is 11 to correspond to the 
next described to be transmitted via one or more of 1DI GROUP I.D. of field 1 of the message of FIG. 18. Let 
elements 614 and over one or more of data links 106 it be assumed that DSC 107 relinquishes its ownership 
from DSC 105 to DSC 107. of the group lock and transmits a message of the type 

The message shown on FIG. 18 is the first in the generally shown in FIG, 19 back to DSC 105. At this 
sequence of messages that is transmitted over data link 60 time, the opcode for the message is GRANT OWNER- 
106 for the provision of extended dual copy service for SHIP and the GROUP I.D. for the message is 11. Fol- 
a record accompanying each subsequently received lowing the exchange of the REQUEST OWNERSHIP 
write data command directed to volume 3 of DSC 105. message followed by the receipt back of the GRANT 
Field 0 contains the ESTABLISH opcode for the roes- OWNERSHIP message, DSC 105 owns the lock for 
sage. The GROUP I.D. field 1 contains an arbitrary 65 extended copy group 11 and proceeds with the function 
number which identifies the group to be established. Let of causing an extended dual copy of the record to be 
it be assumed that the GROUP I.D. is 11. The GROUP written. If DSC 107 had been unable to immediately 
TYPE field 2 identifies the service to be provided for grant ownership, it would have sent back a message of 
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the type shown in FIG. 20 back to DSC 105. This mes- TRANSFER message of FIG. 22 was received by DSC 
sage would contain an opcode of REFUSAL in field 0, 107. 
a GROUP I.D. of 11 to identify the group involved and 

a REFUSAL code indicating the specific reason why Extended Multiple Copy Service 

DSC 107 refused the request. FIG. 20 also portrays the 5 A system embodying the principles of the present 
format of a message having an opcode of ACKNOWL- invention can also be used as shown in FIG. 12 to pro- 
EDGE in field 0, a GROUP I.D. in field 1 and an AC- vide extended multiple copy service where the number 
KNOWLEDGMENT return code in field 2. The func- of copies to be provided is limited only by the number 
tion of the acknowledgment message is subsequently of separate DASD subsystems utilized. FIG. 12 dis- 
described. 10 closes a plurality of DSCs 105, 107 and 127 intercon- 

Next, local DSC 105 transmits a message of the type nected by direct data links 106, 126 and 136. Paths 104, 
shown in FIG. 21 over data link 106 to remote DSC 124 and 134 connect the DSCs with a host computer 
107. Messages of the type generally shown in FIG. 21 individual to each DSC. Paths 108, 110 and 120 connect 
contain a number of alternative opcodes in its field 0. each DSC with a disk controller and disk drives such as 
These are PERFORM DEBEVAGE or READ 15 disk controller 112 and disk drives 109 for DSC 105 
FROM BEVY REQUEST or READY TO RECEIVE In accordance with the invention. DSC 105 may 
DATA or READ FROM BEVY COMPLETE. The receive a command sequence of the type already de- 
message that is transmitted at this time has the opcode scribed on FIG. 14 from its host processor 101 instruct- 
or PERFORM DEBEVAGE in field 0. The GROUP ing it to provide extended multiple copy service for 
I.D. field 1 contains an 11 to correspond to the GROUP 20 subsequently received write operations directed to a 
I.D. of FIGS. 18 and 19. Field 2 of this message identi- user specified volume identified in the command se- 
fies the track on the particular disk drive of DSC 107 quence that establishes the extended multiple copy ser- 
that is to be written. The TRACK ID is designated as vice. Let it be assumed that a user at host 101 identifies 
DCCHH. The D identifies the device that is to be writ- volume 3 of local disk drives 109, remote volume 1 at 
ten CCHH comprises the cylinder and track address on 25 remote disk drives 111 of DSC 107 and remote volume 
the identified device. 2 of disk drives 121 serving DSC 127. DSC 105 receives 

This message of FIG. 21 also contains a field termed this command sequence and prepares itself for the sub- 
CACHE RECORD DESCRIPTOR whose subfields sequent provision of extended multiple copy service in 
are shown on line 2 of FIG. 21. Subfield 3 is a MODI- a manner analogous to that already described for the 
FIED FIELD INDICATOR which indicates the fields 30 system operations associated with extended dual copy 
of the record that have been modified in the cache service. 

memory of DSC 105. Subfield 4 contains an INTER- Subsequently, let it be assumed that write commands 
NAL RECORD NUMBER which is the ordinal posi- are received identifying local volume 3 on a disk drive 
tion of the record on the track. Subfield 5 contains the 109. In this case, DSC 105 responds to the receipt of 
KEY OFFSET. Subfield 6 contains a DATA OFF- 35 each such write command identifying local volume 3 
SET. Both of these are the relative byte position from and transmits the received record together with accom- 
the beginning of the record that's going to be subse- panying control messages over direct data link 106 to 
quently sent and indicates where the key field starts and DSC 107 which operates as priorly described for ex- 
where the data field starts. The DASD SEGMENT tended dual copy service. DSC 107 additionally trans- 
NUMBER of field 7 indicates the angular rotational 40 mits the received record and accompanying control 
position on the track where the record actually begins. messages over direct data link 126 to DSC 127 which 
The RECORD LOGICAL IDENTIFIER of fields 8, 9 operates in a manner similar to of DSC 107. DSC may 
and 10 is user controllable and comprises the CCHHR further transmit the received record and associated 
address information, the KEY LENGTH information control messages over data link 136 to DSC 105 which 
and the DATA LENGTH of the count field that actu- 45 uses the received information as a check on the correct 
ally is going to be sent in a CKD transfer message as operation of DSCs 107 and 127. The individual DSCs 
subsequently described. 105, 107 and 127 may then operate in a manner similar 

In response to the reception of the PERFORM to that priorly described to record the received data 
DEBEVAGE message of FIG. 21, the remote DSC 107 record on the disk drives associated with each such 
returns a message of the type shown in FIG, 21 and 50 DSC. 

containing the opcode of READY TO RECEIVE The channel program used to establish extended mul- 
DATA in its field 0. The information in the other fields tiple copy service is similar to that described for ex- 
or this message is identical to that for the PERFORM tended dual copy service. In this case, the request 
DEBEVAGE message as already described. packet of FIG. 17 identifies the local volume in its field 

Local DSC 105 now transmits the CKD transfer 55 2 and identifies the remote volumes for the various 
message shown in FIG. 22 over data link 106 to DSC remote DSCs is its fields 3* through 3i through 3* 
107. This message contains the actual contents of the where n equals the total number of DSCs. With respect 
record that is to be written by volume 1 of DSC 107. to FIG. 18, the ESTABLISH message contains EX- 
TJus message contains the opcode of CKD TRANS- TENDED MULTIPLE COPY in its field 2 and in line 
FER in its field 0 and in fields 1, 2 and 3 contain the 60 2 of FIG. 18 contains fields 4a, through 4i. through 4n 
COUNT FIELD information, the KEY FIELD infor- with each such field identifying the volume in each 
mation and the DATA FIELD of the record that is to DSC that is to be used to provide multiple copy service 
be written. The KEY FIELD is, of course, optional. In With respect to FIG. 12 and line 2 of FIG. 18, field 4a 
response to the transmission of the CKD TRANSFER identifies volume of DSC 107, field 4i identifies volume 
message of FIG. 22, the remote DSC returns an AC- 65 2 of DSC 127 and field 4n identifies volume 3 of DSC 
KNOWLEDGMENT message of the type shown in 105 DSC 107 receives the described messages for ex- 
FIG. 20. At this time, the opcode for the message is tended dual copy service and operates to cause each 
ACKNOWLEDGE to indicate that the CKD received record to be written on its volume 1. DSC 107 
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also extends the received messages over data link 126 to 
DSC 127 which operates in a similar manner to cause a 
copy of the received record to be written by volume or 
disk drive 2 to which DSC 127 is connected. DSC 127 
further extends the messages it receives over data link 
136 back to DSC 105. The DSC 105 receives the mes- 
sages over data link 136 and verifies that the system has 
performed as expected. 

The system may also be operated so that copies of a 
record may need not be written by a drive of one or 
more DSCs in a system having n DSCs and n groups of 
disk drives This is accomplished by inserting a phantom 
or fictitious volume ID in the RV-field of the Request 
Packet of FIG. 17 for the DSC whose disk drives are 
not to write the received record and to insert the same 
phantom volume ID in the RV-field of the message of 
FIG. 18 for this DSC whose disk drives are not to write 
the received record. 

Description of FIG. 13 

FIG. 13 discloses further details of a DSC, such as 
DSC 105 of FIG. 12, equipped for the provision of 
extended multiple copy service for the generation of 
more than two copies for each write request received 
by a DSC, such as DSC 105, for a priorly specified local 
volume at DSC 105. 

The details of the DSC 105 of FIG. 13 is generally 
similar to the DSC 105 equipped for extended dual copy 
service and shown in detail on FIGS. 6 through 8. This 

being the case, FIG. 13 discloses only the details of 30 DSC 107 so that users at these two host processors can 
DSC 105 that differ from the disclosure of FIGS. 6 jointly have access to the records written by both sets of 
through 8. users on the specified disk drive 111. It should be under- 

As is the case on FIGS. 6 through 8 ( DSC 105 on stood that a disk drive 109 associated with DSC 105 
FIG. 11 is equipped with a pair of IDI elements 614-0 does not write these jointly shared records for the EX- 
and 614-1 which extend over direct data link paths 35 TENDED CONNECTIVITY service of FIG. 4. 
106-0 and 106-1 to the next DSC such as, for example, The process begins when a channel program similar 
DSC 107 as shown on FIG. 12. The connections to to that shown on FIGS. 14 through 17 is received by 
these two IDI elements are identical to that shown on DSC 105 to establish EXTENDED CONNECTIV- 
FIGS. 6 through 8. In addition, DSC 105 of FIG. 11 ITY service. The command sequence is of the type 
contains a pair of IDI elements 614-2 and 614-3 which 40 shown on FIG. 14. However, the REQUEST 



DSC 107 also operates to extend the received record 
and associated commands via its IDI elements corre- 
sponding to elements 614-0 and 614-1 of FIG. 11 and 
over a data link such as data link 126 on FIG. 12 to DSC 
5 127. DSC 127 receives these commands and data record 
on its IDI elements corresponding to elements 614-2 
and 614-3 of FIG. 13. The cache memory, the micro- 
processor and the memory of DSC 127 then together 
cooperatively cause the received record to be recorded 
10 on a priorly specified volume of a disk drive 121. 

DSC 127 then extends the received control messages 
out over data link 136 and back to DSC 105 where the 
received information is received by IDI elements 614-2 
and 614-3 over data link 136. The received control 
messages are applied via the RC leads and via the ICA 
elements 607 of FIG. 7 to microprocessor 608 and mem- 
ory 612. The microprocessor and the memory process 
the received information as a verification of the correct 
operation of the other DSCs in the system of FIG. 12. 

Extended Connectivity Service 

The following describes the manner in which the 
system of the invention operates to transmit messages 
between DSC 105 and DSC 107 when EXTENDED 
CONNECTIVITY service is to be provided by the 
system of FIG. 4 for users of host processors 101 and 
121. In this configuration some but not all of the records 
generated by users at each host processor are to be 
shared and written on only a specified disk drive 111 of 
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are connected over paths 136-0 and 136-1 of data link 
136 to a preceding DSC such as, for example, DSC 127 
as shown on FIG. 12. IDI elements 614-2 and 614-3 are 
connected to the same RC conductors 612-0, 612-1, 
612-2 and 612-3 as are IDI elements 614-0 and 614-1. In 
addition, IDI elements 614-2 and 614-3 are connected 
over data paths 616-2 and 616-3 to cache memory 512. 
These two additional IDI elements communicate with 
cache 512 in the same manner as do IDI elements 614-0 
and 614-1 over data paths 616-0 and 616-1. 

DSC 105 responds to commands similar to those 
priorly described to prepare itself for the provision of 
extended multiple copy service to a user-specified local 
volume 109 associated with DSC 105. Subsequently, 
when write requests are received that are directed to 55 
this specified local volume, DSC 105 and cache mem- 
ory 512 transmit the appropriate messages and com- 
mands via an IDI element 614 to the next DSC, such as 
DSC 107, over data links 106-0 and 106-1. This record 
and the associated commands are received by DSC 107 60 
by its IDI elements corresponding to IDI elements 
614-2 and 614-3 of FIG. 13. The received record data 
and command signals are applied to the cache memory 
of DSC 107 and to its microprocessor and memory 
corresponding to microprocessor 608 and memory 612 65 
of DSC 105. These elements together jointly cause the 
received data record to be written on a priorly specified 
remote volume 111 of DSC 107. 



PACKET of FIG. 17 contains different data in certain 
fields to condition DSC 105 to provide the EX- 
TENDED CONNECTIVITY service for subsequently 
received write requests directed to a specified volume 
of DSC 105. Specifically, field 0 of FIG. 17 contains 
MECG 6. Since a volume of DSC 105 is not to be writ- 
ten with a record accompanying such a subsequently 
received write request, the local volume identification 
in FIG. 17 field 2 identifies a phantom volume of DSC 
105 having no physical correspondence in disk drives 
109. Field 3 of FIG. 17 identifies the volume 111 of 
DSC 107 that is to be written when the user at a host 
processor 101 generates such a subsequently received 
write request. In other words, DSC 105 is conditioned 
by the receipt of the command sequence shown in 
FIGS. 14 through 17 to write a record accompanying 
each subsequently received write request directed to 
the phantom volume of DSC 105 to the specified re- 
mote volume 111 of DSC 107. 

DSC 105 receives each such subsequently received 
write request from a user at host processor 101 and 
transmits the message sequence about to be described 
over data link 106 to DSC 107. Since the subsequently 
received write request identifies the phantom volume of 
DSC 105, no disk drive 109 writes the received record. 
The message of FIG. 18 is first sent over the data link as 
priorly described. The only difference is that field 2 of 
FIG. 18 now specifies EXTENDED CONNECTIV- 
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ITY service rather than EXTENDED MULTIPLE quent write requests from the host directed to volume 3 

COPY or EXTENDED DUAL COPY SERVICE. of DSC 105. When such requests are received, as subse- 

DSCs 105 and 107 exchange the REQUEST OWNER- quently described, copies of the record accompanying 

SHIP and GRANT OWNERSHIP messages of FIG. each such received write request will be made by both 

19 in order to ensure that the extended copy group lock 5 volume 3 of DSC 105 and volume 1 of DSC 107. 

is owned by the DSC that is processing the current Subsequently, the host transmits the channel program 

channel program. The REFUSAL message of FIG. 20 command sequence required to write a record using the 

is transmitted in the event that the DSC that is to give already established extended dual copy service. Specifi- 

up ownership of the extended copy group lock cannot ca ijy ( m clement 14 the host transmits the standard 

release ownership immediately. The PERFORM 10 DEFINE EXTENT command of FIG. 14 line 2. In 

DEBEVAGE message of FIG. 21 is then transmitted dement 15 the host transmits the standard DEFINE 

by DSC 105 to DSC 107. DSC 107 responds with the EXTENT Parameter List of FIG. 14, line 6. In cle- 

READY TO RECEIVE DATA message of FIG. 21. mcnts 16 ^ 18 ^ host transmits the LOCATE RE- 

The CKD transfer message of FIG. 22 is then transmit- CORD command of FIG. 14 line 3 followed by the 

ted over data link 106 to DSC 107. This message con- 15 sUuid ard LOCATE RECORD Parameter List of FIG. 

tains the record information that is to be written by the u linc 7 ln c|cmcm 19 ^ ^ transmits th c WRITE 

specified volume 111 that has been priorly identified DATA command of FIG. 14 line 4 followed by element 

and selected for use for this jointly shared data DSC 20 which transmits the DATA BLOCK to be written of 

107 receives the message of FIG. 22 and responds with pjQ ^ g 

the acknowledgment message of FIG. 20 which is re- 20 In dcmcnt 21 DSC 105 transmits thc REQUEST 

turned over the data hnk 106 to DSC 105. Once a re- OWNERSHIP message of FIG. 19 over data link 106 

cord or records generated by users of host processor XQ DSQ 10? , n demcn| J2 Dsc 1Q7 thc 

101 are written to the specified volume 111 of DSC 107 ^ Qf ^ REQU£ST OWNERSHIP message and 

the contents of this volume may be jointly shared and . f . . Mq ^ |Qck or |oken ^ %Q D$c m %% 

read in the conventional manner by users at host proces- 25 ^ * ^ trinsmitUng the GRANT 

sor 121 in the same manner as these users can read any nufXTCDcum fri - . . . 

- . , ... i^e^ , A . * OWNERSHIP message of FIG. 19 over data link 106 

of the volumes 111 connected to DSC 107. The users at , . 4 r^**- «ai V t . • i . - M 

. 4 i • • *.i t. j i back to DSC 105. Next, in element 24, DSC 105 trans- 

host processor 101 can read the jointly shared volume . t . nrorADunroct^rr ' ftI « 

111 by transmitting a standard read command sequence mi,s 5**™** D ^X^M™f^i ?'i 
directed to the priorly specified phantom volume of 30 Imk 1( * to D f SC ™. Ne "; " £ 

DSC 105. DSC 105 receives this command sequence *°Jj«^ d * b * traiismittmg *e READY TO 

and transmits the READ FROM BEVY REQUEST ^^J?*™™?**? °? J* ° VCT 
message of FIG. 21 over the data link 106 to DSC 107 DS <= 105 Al th,s ^ °SC 105 knows that 

to cause DSC 107 to read the requested record and DSC «f « *° rcce,ve ™ *" 

transmit it back over the data link 106 to DSC 105. DSC 35 raent ' 105 transmits the CKD TRANSFER 

105 then applies the received record to the users of host mcssa S c of ™ G 2 * ovcr dat * Unk ^to DSC 107. This 
processor 101 in the conventional manner. message contains the record data that is to be written by 
v volume 1 of DSC 107. 

Exchange of System Commands & Messages At this time the record data received with the write 

The sequence of system actions associated with the 40 r *J ucst rc0l4ins the cache memory of each of 

establishment of extended dual copy service followed DSCs 105 Md 107 »«d has not « vct **« n wntten bv 

by the writing of a data record to a volume specified for volume 3 of DSC 105 or volume 1 of DSC 107. Next, in 

extended dual copy service is shown on FIGS. 23-25. element 27 A, DSC 105 causes the received record data 

The process begins in element 1 and proceeds to ele- to wriMcn b Y its volume 3 and concurrently there- 

ment 2 in which the host transmits a DEFINE EX- 45 with in element 27B, DSC 107 causes the received re- 

TENT command of FIG. 14 line 2 over the channel to cord data to be written by its volume 1. In element 28, 

DSC 105. In element 3 the host transmits the DEFINE DSC * 07 acknowledges the receipt of the CKD transfer 

EXTENT Parameter List of FIG. 15 to DSC 105. In message by transmitting an ACKNOWLEDGMENT 

element 4 the host transmits a LOCATE RECORD message of FIG. 20 over data link 106 back to DSC 105. 

command of FIG. 14 line 3 to DSC 105. In element 5 50 ^ clement 29, DSC 105 returns a COMMAND COM- 

the host transmits the LOCATE RECORD Parameter PLETE signal over thc channel interface path back to 

List of FIG. 16 to DSC 105. In element 6 the host trans- the host indicating that the requested extended dual 

mits the WRITE DATA command of FIG, 14 line 4 copy write service has been successfully furnished since 

and in element 7 the host transmits the REQUEST the data record received with the write command has 

PACKET of FIG. 17 to DSC 105. In element 8 the host 53 been written by both volume 3 of DSC 105 and volume 

transmits the READ COUNT KEY DATA command I of DSC 107. 

of FIG. 14 line 5 over the channel interface path to The above sequence of commands describes extended 

DSC 105. In element 9 the ESTABLISH message of dual copy service insofar as concerns the time at which 

FIG. IB is transmitted from DSC 105 to DSC 107 over the command complete signal is returned to the host 

data link 106. In element 10 the ACKNOWLEDG- 60 processor. For extended fast dual copy service, the 

MENT message of FIG. 20 is transmitted over data link process is identical to that above-described except that 

106 from DSC 107 to DSC 105. In element 12 DSC 105 the COMMAND COMPLETE signal is sent back to 
transmits a RESPONSE PACKET of FIG, 14 line 9 to the host when the received record information is re- 
the host as an acknowledgment that the preceding com- ceived and acknowledged by the remote DSC 107. 
mands, parameter lists, and information have been re- 65 Local DSC 105 and remote DSC 107 cause the received 
ceived. record information to be written on local volume 3 and 

At this time, both DSC 105 and DSC 107 are condi- remote volume 1 subsequent to the time the command 

tioned to provide extended dual copy service for subse- complete signal is returned to the host. 
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While preferred embodiments of the present inven- 
tion have been shown, it is to be expressly understood 
that modifications and changes may be made thereto 
and that the present invention is set forth in the follow- 
ing claims. 

We claim: 

1. In a data storage system adapted to be connected to 
a host computer, said system comprising: 
a first independently operable data storage control , 
a second independently operable data storage con- 
trol, 

a first recording means comprising a plurality of dif- 
ferent recording elements connected to said first 
data storage control and a second recording means 
comprising a plurality of different recording ele- 
ments connected to said second data storage con- 
trol, 

each of said data storage controls being operable 
independently of each other to effect the writing of 2Q 
a data record by a specified one of the plurality of 
recording elements to which each said data storage 
control is connected, 

a data link transmission path interconnecting said first 
and second data storage controls, 

means in said first data storage control for receiving a 
command from said host computer requesting that 
an accompanying data record for each subsequent 
data record write request directed to a first record- 
ing element of said first recording means be written 
by said first recording element of said first record- 
ing means as well as by a first recording element of 
said second recording means, 

means in said first data storage control for receiving 
from said host computer a write request and an 
accompanying data record requesting that said 
accompanying data record be written by a speci- 
fied recording element of said first recording 
means, 

means unique to said first data storage control and 
operable independently of said second data storage 
control and responsive to the reception of said 
write request and accompanying data record for 
effecting the writing of said data record by said 
specified recording element of said first recording 45 
means, 

means in said first data storage control further re- 
sponsive to the receipt of said write request and 
said accompanying data record when said specified 
recording element of said first recording means 
comprises said first recording element of said first 
recording means for transmitting said write request 
and said accompanying data record over said data 
link transmission path to said second data storage 
control, and 

means unique to said second data storage control and 
operable independently of said first data storage 
control and responsive to the receipt of said write 
request and said accompanying data record over 
said data link transmission path for effecting the 
writing of said data record by said first recording 
element of said second recording means. 

2. The system of claim 1 wherein said data link trans- 
mission path comprises a direct connection between 
said first an second data storage controls that is devoid 
of switching means. 

3. The system of claim 1 in combination with: 
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a third data storage control connected to a third re- 
cording means comprising a plurality of different 
recording elements, 
a second data link transmission path connecting said 
second data storage control with said third data 
storage control, 
means in said second data storage control responsive 
to the receipt of said write request and said accom- 
panying data record for transmitting said write 
request and said accompanying data record over 
said second data link transmission path to said third 
data storage control, and 
means unique to said third data storage control and 
operable independently of said first data storage 
control and said second data storage control and 
responsive to the reception of said write request 
and accompanying data record over said second 
data link transmission path for effecting the writing 
of said data record by a first recording element of 
said third recording means. 

4. The system of claim 1 wherein each of said data 
storage controls contains a cache memory, 

means in each data storage control responsive to the 
receipt of said data record by said each data storage 
control for entering said received data record into 
the cache memory of said each data storage con- 
trol, 

means for returning a command complete signal to 
said host computer from said first data storage 
control when said data record is entered into said 
cache memory of each data storage control, and 
wherein said means for effecting the writing of said 
data record comprises means for applying said data 
record in each cache memory to the recording 
means connected to the data storage control con- 
taining said each cache memory to control the 
writing of said data record by said first recording 
element of said recording means of each data stor- 
age control. 

5. The system of claim 1 wherein a command com- 
plete signal is returned by said first data storage control 
to said host computer after said data record is written 
by said first recording element of said recording means 
of each data storage control. 

6. The system of claim 1 wherein said means in said 
first data storage control for receiving said write re- 
quest and accompanying data record comprises a first 
path extending from said host computer to said first data 

50 storage control for the reception of information includ- 
ing write requests and accompanying data records from 
said host computer; said system further comprising: 
a second path extending from said host computer to 
said second data storage control for the transmis- 
sion of information including write requests and 
accompanying data records from said host com- 
puter to said second data storage control, 
said second data storage control being responsive to 
the receipt of said write requests and accompany- 
ing data records over said second path to effect the 
writing by said first recording element of said sec- 
ond recording means of said data records received 
over said second path. 

7. The system of claim 6 wherein said data link trans- 
mission path comprises a direct connection between 
said first and second data storage controls that is devoid 
of switching means. 

8. The system of claim 6 in combination with: 
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means in second data storage control further respon- 
sive to said receipt of said write requests and ac- 
companying data records received over said sec- 
ond path for transmitting said write requests and 
accompanying data records over said data link 5 
transmission path to said first data storage control, 
and 

means in said first data storage control responsive to 
said receipt of said write requests and accompany- 
ing data records over said data link transmission 10 
path to effect the writing by said first recording 
element of said first recording means of said re- 
cords received by said first data storage control 
over said data link transmission path. 

9. The system of claim 8 wherein said data link trans- 15 
mission path comprises a direct connection between 
said first and second data storage controls that is devoid 

of switching means. 

10. The system of claim 8 wherein each of said data 
storage controls contains a cache memory, 

means in each data storage control responsive to the 
receipt of a write request and accompanying data 
record over said path connected to said data stor- 
age control for entering said received data record ^ 
into the cache memory of said data storage control 
that received said write request and data record 
over said path, 

means for returning a command complete to said host 
computer from the data storage control that re- 3Q 
ceived said write request and data record from said 
host computer when said data record is entered 
into said cache memory of each data storage con- 
trol, and 

wherein said means for effecting the writing of said 35 
data record comprises means for applying said data 
record in each cache memory to the recording 
means connected to the data storage control con- 
taining said each cache memory to control the 
writing of said data record by said first recording 40 
element of said recording means. 

11. The system of claim 9 wherein a command com- 
plete signal is returned to said host computer by a data 
storage control that receives a data record from said 
host computer after said data record is written by each 45 
of said first recording elements of said recording means. 

12. In a data storage system adapted to be connected 
to a host computer, said system comprising: 

a first independently operable data storage control, 
a second independently operable data storage con- 50 
trol, 

a first group of disk drives connected to said first data 
storage control and a second group of disk drives 
connected to said second data storage control, 

each of said data storage controls being operable 55 
independently of each other to effect the writing of 
a data record by a specified one of the disk drives 
to which said each data storage control is con- 
nected, 

a data link transmission path interconnecting said 60 
data storage controls, 

means in said first data storage control for receiving 
data record write requests from said host com- 
puter, 

means unique to said first data storage control and 65 
operable independently of said second data storage 
control and responsive to the reception of a data 
record write request and an accompanying data 



record for effecting the writing of said received 
data record by said first group of disk drives, 

means in said first data storage control for receiving a 
command sequence from said host computer re- 
questing that multiple record copies be written for 
subsequently received record write request di- 
rected to a specified one of said disk drives of said 
first group of disk drives, 

means in said first data storage control responsive to 
the subsequent receipt of a record write request 
and an accompanying data record directed to said 
specified one disk drive for transmitting said re- 
ceived record accompanying said write request 
over said data link transmission path to said second 
data storage control, 

means unique to said first data storage control and 
operable independently of said second data storage 
control and further responsive to said subsequent 
receipt of said record write request for effecting 
the writing of said accompanying record by said 
specified one disk drive of said first group, and 

means unique to said second data storage control and 
operable independently of said first data storage 
control and responsive to the reception of said 
record over said data link transmission path for 
effecting the writing of said record by a disk drive 
of said second group. 

13. The system of claim 12 wherein said data link 
transmission path comprises a direct connection be- 
tween said data storage controls that is devoid of 
switching means. 

14. The system of claim 12 in combination with: 

a third data storage control connected to a third 
group of disk drives, 

a second data link transmission path connecting said 
second data storage control with said third data ' 
storage control, 

means in said second data storage control responsive 
to the receipt of said record for transmitting said 
record over said second data link transmission path 
to said third data storage control, and 

means unique to said third data storage control and 
operable independently of said first data storage 
control and said second data storage control and 
responsive to the receipt of said record over said 
second data link transmission path for effecting the 
writing of said record by a disk drive of said third 
group of disk drives. 

15. The system of claim 12 wherein each of said data 
storage controls contains a cache memory, 

means in each data storage control responsive to the 
receipt of a record by said each data storage con- 
trol for entering said each received record into the 
cache memory of said each data storage control, 

means for returning a command complete signal to 
said host computer from said first data storage 
control when a record received by each data stor- 
age control is entered into said cache memory of 
said each data storage control, and 

wherein said means for effecting the writing of said 
record comprises means for applying said record in 
each cache memory to a disk drive connected to 
the data storage control containing said each cache 
memory to control the writing of said record by 
said disk drive. 

16. The system of claim 12 wherein a command com- 
plete signal is returned to said host computer by said 
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first data storage control after said record is written by 
a disk drive of each of said groups. 

17. The system of claim 12 wherein said means in said 
first data storage control for receiving said record com- 
prises a first path extending from said host computer to 
said first data storage control for the reception of infor- 
mation including data records from said host computer; 
said system further comprising: 
a second path extending from said host computer to 
said second data storage control for the transmis- 
sion of information including data records to said 
second data storage control, 
means in said second data storage control for receiv- 
ing a data record write request over said second 
path from said host computer, 
means in said second data storage control responsive 
to the receipt of each received data record write 
request and an accompanying data record for ef- 
fecting the writing of said accompanying data re- 
cord by said second group of disk drives, 
means in said second data storage control for receiv- 
ing a command sequence from said host computer 
requesting that multiple record copies be written 
for subsequently received data record write re- 
quest directed to a specified one of said disk drives 25 
of said second group of disk drives, 
means in said second data storage control responsive 
to the subsequent receipt of a data record write 
request and accompanying data record directed to 
said specified one disk drive of said second group 30 
for transmitting said received record over said data 
link transmission path to said first data storage 
control, 

means unique to said second data storage control and 
operable independently of said first data storage 35 
control and further responsive to said subsequent 
receipt of said record write request and accompa- 
nying data record for effecting the writing of said 
received record by said specified one disk drive of 
said second group, and 40 
means unique to said first data storage control and 
operable independently of said second data storage 
control and responsive to the receipt of said record 
over said data link transmission path for effecting 
the writing of said record by a disk drive of said 45 
first group of disk drives. 
18. The system of claim 17 wherein each of said data 
storage controls contains a cache memory, 
means in each data storage control responsive to the 
receipt of e record by said each data storage con- 50 
trol for entering said received record into the cache 
memory of said each data storage control, 
means for returning a command complete signal to 
said host computer from said data storage control 
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a first and a second data storage control connected 
via separate ones of said channel interface paths to 
each of said host computers, 
a first group of disk drives connected to said first data 
storage control and a second group of disk drives 
connected to said second data storage control, 
a direct data link transmission path devoid of switch- 
ing means interconnecting said data storage con- 
trols, 

means in each of said data storage controls for receiv- 
ing a data record from either of said host comput- 
ers over said paths, 
means unique to each data storage control and opera- 
ble independently of the other data storage control 
and responsive to the reception of a data record 
over one of said paths for effecting the writing of 
said record by a disk drive of the group to which 
said each data storage control receiving said record 
is connected, 

means in said each data storage control responsive to 
the receipt of said record over one of said paths for 
transmitting said record over said data link trans- 
mission path to the other one of said data storage 
controls, and 

means unique to said other data storage control and 
operable independently of the other data storage 
control and responsive to the reception of said 
record over said data link transmission path for 
effecting the writing of said record by a disk drive 
of the group to which said other data storage con- 
trol is connected. 

20. The system of claim 19 wherein each of said data 
storage controls contains a cache memory, 

means in each data storage control responsive to the 
receipt of said record over an interface path for 
entering said received record into the cache mem- 
ory of each of said data storage controls, 

means for returning a command complete signal to 
said host computer from the data storage control 
that receives a record over an interface path when 
said received record is entered into said cache 
memory of each of said data storage controls, and 

wherein said means for effecting the writing of said 
received record comprises means for applying said 
record in each cache memory to a disk drive con- 
nected to the data storage control containing said 
each cache memory to control the writing of said 
record by said disk drive of each data storage con- 
trol. 

21. The system of claim 19 wherein a command com- 
plete signal is relumed by said first data storage control 
to said host computer after said record is written by a 
drive in each of said groups of disk drives. 

22. In a data storage system adapted to be connected 



receives a record from said host computer 55 over channel interface paths to a first and a second host 



when said record is entered into said cache mem 
ory of each data storage control, and 
wherein said means for effecting a writing of each 
record comprises means for applying a record in 
each cache memory to a disk drive connected to 60 
the data storage control containing said each cache 
memory to control the writing of said record by 
said disk drive. 
19. In a data storage system adapted to be connected 
over channel interface paths to a first and a second host 65 
computer for the writing of multiple copies of records 
received by said system ovct any of said paths from 
either of said host computers, said system comprising: 



computer fox the writing of multiple copies of records 
received by said system over any of said paths from 
either of said host computers, said system comprising: 
m independently operable data storage controls con- 
nected via separate ones of said channel interface 
paths to each of said host computers, 
m groups of disk drives each group of which is indi- 
vidual to and connected to a different one of said 
data storage controls, 
a plurality of direct data link transmission paths de- 
void of switching means interconnecting said data 
storage controls wherein each data link transmis- 
sion path interconnects a unique pair of said data 
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storage controls and wherein each of said data 
storage controls is connected by one of said data 
link transmission paths to another one of said data 
storage controls, 

means in each of said data storage controls for receiv- 5 
ing a data record over one of said paths from either 
of said host computers, 

means in each data storage control responsive to the 
receipt of a data record over one of said paths for 
effecting the writing of said record by a disk drive 10 
of the group to which said each data storage con- 
trol receiving said record is connected, 

means in said each data storage control responsive to 
the receipt of said record over one of said paths for 
transmitting said record over the one of said data 15 
link transmission paths connected to said each data 
storage control to the other one of said data storage 
controls that is connected to said last named data 
link transmission path, 

means in said other data storage control responsive to 20 
the receipt of said record over said data link trans- 
mission path for effecting the writing of said record 
received over said data link transmission path by a 
disk drive of the group to which said other one 
data storage control is connected, and 25 

means in said other data storage control for extending 
said received record over another one of said data 
link transmission paths to which said other data 
storage control is connected to another one of said 
data storage controls for the writing of said record 30 
by a disk drive of the group to which said last 
named data storage control is connected. 

23. In a data storage system adapted to be connected 
over channel interface paths to a first and a second host 
computer for the writing of multiple copies of records 35 
received by said system over any of said paths from 
either of said host computers, said system comprising: 

m data storage controls connected via separate ones 
of said channel interface paths to each of said host 
computers, 40 

m groups of disk drives each group of which is indi- 
vidual to and connected to a different one of said 
data storage controls, 

a plurality of direct data link transmission paths de- 
void of switching means interconnecting said data 45 
storage controls wherein each data link transmis- 
sion path interconnects a unique pair of said data 
storage controls and wherein each of said data 
storage controls is connected over one of said links 
to another one of said data storage controls, 50 

means in each data storage control for receiving 
channel program command sequences from one of 
said host computers over one of said interface paths 
with each sequence requesting the control of func- 
tions by said each data storage control, 55 

means in said each data storage control responsive to 
the receipt of each program command sequence 
comprising a record write request and an accompa- 
nying record for effecting the writing of a said 
accompanying record by a disk drive of the group 60 
connected to said each data storage control, 

means in said each data storage control for receiving 
a command sequence over an interface path from 
said host computer requesting multiple copy ser- 
vice for a subsequently received write request and 65 
accompanying record directed to a specified one of 
said disk drives of said group connected to said 
each data storage control, wherein said last named 



command sequence also specifies a disk drive in 
each of said n groups that is to be used to write 
multiple copies of a received record for a subse- 
quently received write request directed to said 
specified one drive of said group connected to said 
each data storage control, 

means in said each data storage control responsive to 
the subsequent receipt of a command sequence 
comprising a record write request and an accompa- 
nying record directed to said specified one drive of 
said group connected to said each data storage 
control for transmitting said accompanying record 
over a data link transmission path to a data storage 
control connected by said link to said each data 
storage control, 

means in said each data storage control further re- 
sponsive to the receipt of said subsequently re- 
ceived record write request and said accompany- 
ing record directed to said specified one disk drive 
of said group connected to said each data storage 
control for effecting the writing of said received 
record by said specified one disk drive of said 
group connected to said each data storage control, 

means in said data storage control connected by said 
link to said each data storage control responsive to 
the receipt of said record over said data link trans- 
mission path for effecting the writing of said record 
by said specified disk drive to which said last 
named data storage control is connected, and 

means in said data storage control connected by said 
link to said each data storage control responsive to 
the receipt of said record over said data link trans- 
mission path for extending said received record 
over another one of said data link transmission 
paths to another one of said data storage controls 
for both controlling the writing of said record on a 
specified disk drive connected to said other data 
storage control and for further extending said re- 
cord over a data link transmission path to another 
data storage control so that each other of said data 
storage controls receives said record over a data 
link transmission path and controls the writing of 
said record on a disk drive connected to said each 
other data storage control. 

24. In a data storage system adapted to be connected 
to a host computer, said system comprising: 

m data storage controls, 

m disk drives each of which is connected to a differ- 
ent one of said data storage controls, 

a plurality of data link transmission paths each of 
which interconnects a different pair of said data 
storage controls, 

means in a first one of said data storage controls for 
receiving a data record from said host computer, 

means unique to said first data storage control and 
operable independently of each other data storage 
control and responsive to the reception of said 
record for effecting the writing of said record by a 
first disk drive connected to said first data storage 
control, 

means in said first data storage control further re- 
sponsive to the receipt of said record for transmit- 
ting said record over a data link transmission path 
interconnecting said first data storage control and a 
second data storage control, 

means unique to said second data storage control and 
operable independently of each other data storage 
control and responsive to the reception of said 
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record over said data link transmission path for 
effecting the writing of said record by a second 
disk drive connected to said second data storage 
control, and 

means in said second data storage control further 5 
responsive to said receipt of said record for extend- 
ing said record over a data link transmission path to 
another one of said data storage controls so that 
each other one of said data storage controls re- 
ceives said record and controls the writing of said 10 
record by a disk drive connected to each other one 
of said data storage controls. 

25. In a data storage system adapted to be connected 
to a host computer, said system comprising: 

a first and a second data storage control, is 

a first group of disk drives connected to said first data 
storage control and a second group of disk drives 
connected to said second data storage control, 

a data link transmission path interconnecting said first 
data storage control and said second data storage 20 
control, said data link transmission path comprising 
a direct path devoid of a switching node, 

a channel interface path interconnecting said host 
computer and said first data storage control, 

means in said first data storage control for receiving 25 
channel program command sequences over said 
interface path requesting the control of functions 
by said first data storage control including the 
writing of data records by said first group of disk 
drives, 30 

means unique to said first data storage control and 
operable independently of said second data storage 
control and responsive to the receipt of each pro- 
gram command sequence comprising a record 
write request and an accompanying record for 35 
effecting the writing of a said accompanying re- 
cord by a disk drive of said first group as specified 
by said received write request, 

means in said first data storage control for receiving a 
command sequence from said host computer re- 40 
questing multiple copy service for a subsequently 
received write request directed to a specified one 
of said disk drives of said first group, wherein said 
last named command sequence specifies a disk 
drive of each of said first and second groups that is 45 
to be used to write said multiple copies of an ac- 
companying record for each subsequently received 
write request directed to said specified one drive of 
said first group, 
means in said first data storage control responsive to 50 
the subsequent receipt of a command sequence 
comprising a record write request and an accompa- 
nying record directed to said specified one drive of 
said first group for transmitting said accompanying 
record over said data link transmission path to said 55 
second data storage control, 
means unique to said first data storage control opera- 
ble independently of said second data storage con- 
trol and further responsive to the receipt of said 
subsequently received record write request and an 60 
accompanying record directed to said specified one 
disk drive of said first group for effecting the writ- 
ing of said received record by said specified one 
disk drive of said first group, and 
means unique to said second data storage control and 65 
operable independently of said first data storage 
control and responsive to the receipt of said record 
over said data link transmission path for effecting 
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the writing of said record by said specified disk 
drive of said second group. 

26. The system of claim 25 wherein said channel 
program command sequence comprises: 

commands arranged according to a predetermined 
channel program command format with at least 
some of said commands having a parameter list 
associated therewith and at least one of said com- 
mands having an information block associated 
therewith, 

said parameter lists and said information block being 
adapted to contain data arranged into either a first 
or a second data format, 
said parameter list and said information block being in 
a first format when a received channel program 
command sequence comprises a request for the 
subsequent provision of multiple copy service for 
records subsequently written to said specified one 
disk drive of said first group of disk drives, 
said parameter list being in a second format when a 
received command sequence comprises a record 
write request, 

27. The system of claim 26 wherein said system fur- 
ther comprises; 

a third data storage control connected to a third 
group of disk drives and wherein said command 
sequence requesting multiple copy service further 
specifies a drive of said third group of disk drives, 
said system further comprising; 
a second data link transmission path connecting said 
second data storage control with said third data 
storage control, 
means in said second data storage control responsive 
to the receipt of said record over said data link 
transmission path from said first data storage con- 
trol for transmitting said record over said second 
data link transmission path to said third data stor- 
age control, and 
means in said third data storage control and operable 
independently of said first and second data storage 
control and responsive to the receipt of said record 
for effecting the writing of said record by said 
specified disk drive of said third group. 

28. The system of claim 26 wherein said system fur- 
ther comprises: 

a cache memory in each of said data storage controls, 
means in each data storage control responsive to the 
receipt of a record by said each data storage con- 
trol for entering said received record into the cache 
memory of said each data storage control, 
means for returning a command complete signal said 
to said host computer from said first data storage 
control when each record received by each data 
storage control is entered into said cache memory 
of said each data storage control, and 
wherein said means for effecting the writing of each 
of said records comprises means for applying each 
record in a cache memory to a disk drive con- 
nected to the data storage control containing said 
cache memory. 

29. The system of claim 26 wherein a command com- 
plete signal is returned by said first data storage control 
to said host computer after said record is written by 
each of said disk drives. 

30. The system of claim 26 wherein said system fur- 
ther comprises: 

a second channel interface path extending from said 
host computer to said second data storage control 
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for the transmission of channel program command 
sequences to said second data storage control, 
means in said second data storage control for receiv- 
ing channel program command sequences over 
said interface path requesting the control of func- 5 
tions by said second data storage control including 
the writing of data records by said second group of 
disk drives, 

means in said second data storage control responsive 
to the receipt of each program command sequence 10 
comprising a record write request for effecting the 
writing of a record accompanying said request by a 
disk drive of said second group as specified by said 
received write request, 

means in said second data storage control for receiv- 1 5 
ing a command sequence from said host computer 
requesting multiple copy service for subsequently 
received record write requests directed to a speci- 
fied one of said disk drives of said second group, 
wherein said last named command sequence speci- 20 
fies a disk drive of each of said first and second 
groups that is to be used to write said multiple 
copies of records for subsequently received write 
requests to said specified one disk drive of said 
second group, 25 

means in said second data storage control responsive 
to the subsequent receipt of a command sequence 
comprising a record write request directed to said 
specified one disk drive of aid second group for 
transmitting said record over said data link trans- 30 
mission path to said first data storage control, 

means in said second data storage control further 
responsive to the receipt of said subsequently re- 
ceived record write request to said specified one 
disk drive of said second group for effecting the 35 
writing of said record by said specified one disk 
drive of said second group, and 

means in said first data storage control responsive to 
the receipt of said record over said data link trans- 
mission path from said second data storage control 40 
for effecting the writing of said record by said 
specified disk drive of said first group. 

31 . In a data storage system adapted to be connected 
over channel interface paths to a first and a second host 
computer for the writing of duplicate copies of record 45 
received by said system over any of said paths from 
either of said host computers, said system comprising: 

a first and a second data storage control connected 
via separate ones of said channel interface paths to 
each of said host computers, 50 

a first group of disk drives connected to said first data 
storage control and a second group of disk drives 
connected to said second data storage control, 

a direct data link transmission path interconnecting 
said data storage controls, 55 

means in each of said data storage controls for receiv- 
ing data record write requests from either of said 
host computers over said paths, 

means in each data storage control and operable inde- 
pendently of the other storage control and respon- 60 
live to the receipt of each data record write request 
over one of said paths for effecting the writing of a 
data record accompanying said request by a disk 
drive to which said each data storage control is 
connected, 65 

means in each of said data storage controls for receiv- 
ing a request from said host computer for the provi- 
sion of multiple copy service upon the subsequent 



receipt of a record write request directed to a spec- 
ified one disk drive of said group connected to said 
each data storage control, 
means in each of said data storage controls operable 
independently of the other data storage control and 
responsive to the subsequent receipt of a write 
request directed to said specified one disk drive for 
controlling the writing of a data record accompa- 
nying said request by the specified one disk drive 
connected to said each data storage control and for 
transmitting said record over said data link trans- 
mission path to the other one of said data storage 
controls, and 

means in said other data storage control responsive to 
the receipt of said record over said data link trans- 
mission path for effecting the writing of said record 
by a specified one of said disk drive to which said 
other one data storage control is connected. 
32. A method of operating a data storage system 
adapted to be connected to a host computer, said system 
comprising: 

a first independently operable data storage control, 
a second independently operable data storage con- 
trol, 

a first recording means comprising a plurality of dif- 
ferent recording elements connected to said first 
data storage control and a second recording means 
comprising a plurality of different recording ele- 
ments connected to said second data storage con- 
trol, and 

each of said data storage controls being operable 
independently of each other to effect the writing of 
a data record by a specified one of the plurality of 
recording elements to which each said data storage 
control is connected, 

a data link transmission path interconnecting said first 
and second data storage controls, 

said method comprising the steps of: 

operating said first data storage control for receiving 
a command from said host computer requesting 
that an accompanying data record for each subse- 
quent data record write request directed to a first 
recording element of said first recording means be 
written by said first recording element of said first 
recording means and by a first recording element 
of said second recording means, 

operating said first data storage control for receiving 
from said host computer a write request and an 
accompanying data record requesting that said 
accompanying data record be written by a speci- 
fied recording element of said first recording 
means, 

operating said first data storage control indepen- 
dently of said second data storage control and in 
response to the receipt of said write request and 
accompanying data record for effecting the writing 
of said data record by said specified recording 
element of said first recording means, 

operating said first data storage control in further 
response to the receipt of said write request and 
said accompanying data record when said specified 
recording element of said first recording means 
comprises said first recording element of said first 
recording means for transmitting said write request 
and said accompanying data record over said data 
link transmission path to said second data storage 
control, and 
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operating said second data storage control indepen- 
dently of said first data storage control and in re- 
sponse to the receipt of said write request and ac- 
companying data record over said data link trans- 
mission path for effecting the writing of said data 
record by said first recording element of said sec- 
ond recording means. 

33. The method of claim 32 wherein said data link 
transmission path comprises a direct connection be- 
tween said first and second data storage controls that is 
devoid of switching means. 

34. The method of claim 32 in combination with the 
additional steps of: 

operating said second data storage control in re- 
sponse to the receipt of said write request and ac- 
companying data record over said data link trans- 
mission path for transmitting said write request and 
accompanying data record over a second data link 
transmission path to a third data storage control, 
and 

operating said third data storage control indepen- 
dently of said first and second data storage control 
and in response to the receipt of said write request 
and accompanying data record over said second 
data link transmission path for effecting the writing 
of said data record by a first recording element of 
a third recording means connected to said third 
data storage control 

35. The method of claim 32 wherein said method 
further includes the steps of: 

operating each data storage control in response to the 
receipt of said write request and accompanying 
data record by said each data storage control for 
entering said received data record into a cache 
memory of said each data storage control, 

returning a command complete signal to said host 
computer from said first data storage control when 
said data record is entered into said cache memory 
of said each data storage control, and 

wherein said step of effecting the writing of said data 
record comprises the step of applying said data 
record in each cache memory to the recording 
means connected to the data storage control con- 
taining said each cache memory to control the 45 
writing of said record by said first recording ele- 
ment of said recording means of said each data 
storage control. 

36. The method of claim 32 wherein a command 
complete signal is returned by said first data storage 50 
control to said host computer after said record is writ- 
ten by said first recording element of each of said re- 
cording means. 

37. The method of claim 32 wherein said first data 
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ond recording means of said data records received 
over said second path. 

38. The method of claim 37 wherein said data link 
transmission path comprises a direct connection be- 
tween said first and second data storage controls that is 
devoid of switching means. 

39. The method of claim 37 in combination with the 
steps of: 

further operating second data storage control in re- 
sponse to said receipt of said write requests and 
accompanying data records received over said 
second path for transmitting said write requests 
and accompanying data records over said data link 
transmission path to said first data storage control, 
and 

operating said first data storage control indepen- 
dently of said second data storage control and in 
response to said receipt of said data records over 
said data link transmission path to effect the writing 
by said first recording element of said first record- 
ing means of said records received by said first data 
storage control over said data link transmission 
path. 

40. The method of claim 39 wherein said data link 
transmission path comprises a direct connection be- 
tween said first and second data storage controls that is 
devoid of switching means. 

41. The method of claim 39 wherein said method 
further comprises the steps of: 

operating each data storage control in response to the 
receipt over said path connected to said data stor- 
age control of a write request and accompanying 
data record for entering said data record into a 
cache memory of said data storage control that 
received said data record over said path, 

returning a command complete to said host computer 
from the data storage control that received said 
data record from said host computer when said 
record is entered into said cache memory of each 
data storage control, and 

wherein said step of effecting the writing of said data 
record comprises the step of applying said data 
record in each cache memory to the recording 
means connected to the data storage control con- 
taining said each cache memory to control the 
writing of said record by said recording means. 

42. The method of claim 39 wherein said method 
further includes the step of: 

returning a command complete signal to said host 
computer from a data storage control that receives 
a data record from said host computer after said 
record is written by each of said recording ele- 
ments of each of said recording means. 

43. A method of operating a data storage system 
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S *?™?*/aT°!^^~* [ * r ^ UCS ! ac ^ om ; 55 adapted to be connected to a host computer, said system 
nam « nn » a*** — ' - «~ * * u — * ■*-- including a first independently operable data storage 

control and a second independently operable data stor- 
age control, said method comprising the steps of: 
operating said first data storage control indepen- 
dently of said second data storage control and in 
response to the receipt from said host computer of 
a received data record write request and an accom- 
panying data record for effecting the writing of 
said accompanying data record by a first group of 
disk drives connected to said first data storage 
control, 

operating said first data storage control for receiving 
a command sequence from said host computer 



panying data record over a first path extending from 
said host computer to said first data storage control; said 
method further comprises the steps of: 
transmitting information including write requests and 
accompanying data records from said host com- 
puter to said second data storage control over a 
second path extending from said host computer to 
said second data storage control and 
operating said second data storage control indepen- 
dently of said first data storage control in response 65 
to the receipt of write requests and accompanying 
data records over said second path to effect the 
writing by said first recording element of said sec- 
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requesting that multiple record copies be written 
for subsequently received record write request 
directed 10 a specified one of said disk drives of said 
first group, 

operating said first data storage control in response to 5 
the subsequent receipt of a record write request 
and an accompanying data record directed to said 
specified one disk drive for transmitting said re- 
ceived record associated with said request over a 
data link transmission path to said second data 10 
storage control, 

further operating said first data storage control inde- 
pendently of said second data storage control and 
in response to said subsequent receipt of a record 
write request directed to said specified one disk 15 
drive of said first group for effecting the writing of 
said received record by said specified one disk 
drive of said first group of disk drives, and 

operating said second data storage control indepen- 
dently of said first data storage control and in re- 20 
sponse to the receipt of said record over said data 
link transmission path for effecting the writing of 
said record by a disk drive of a second group of 
disk drives connected to said second data storage 
control. 25 

44. The method of claim 43 wherein said data link 
transmission path comprises a direct connection be- 
tween said data storage controls that is devoid of 
switching means. 

45. The method of claim 43 in combination with the 30 
steps of: 

operating said second data storage control in re- 
sponse to the receipt of said record for transmitting 
said record over a second data link transmission 
path 10 a third data storage control, and 35 

operating said third data storage control indepen- 
dently of said first data storage control and said 
second data storage control and in response to the 
receipt of said record for effecting the writing of 
said record by a disk drive of a third group of 40 
drives connected to said third data storage control. 

46. The method of claim 43 wherein said method 
further comprises the steps of: 

operating each data storage control in response to the 
receipt of a record by said each data storage con- 45 
trol for entering said each received record into a 
cache memory of said each data storage control, 

returning a command complete signal to said host 
computer from aid first data storage control when 
a record received by each data storage control is 50 
entered into said cache memory of said each data 
storage control, and 

wherein said step of effecting the writing of each of 
said records comprises the step of applying a re- 
cord in each cache memory to the disk drive con- 55 
nected to the data storage control containing said 
each cache memory to control the writing of said 
record by said disk drive. 

47. The method of claim 43 in combination with the 
step of: 60 

returning a command complete signal to said host 
computer from a data storage control that receives 
a record from said host computer after said record 
is written by each of said disk drives. 

48. The method of claim 43 wherein said first data 65 
storage control receives said record over a first path 
extending from said host computer to said first data 
storage control for the reception of information includ- 
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ing a data record from said host computer; said method 
further comprising the steps of: 

transmitting information including a data record to 
said second data storage control over a second path 
extending from said host computer to said second 
data storage control, 

operating said second data storage control for receiv- 
ing a data record write request from said host com- 
puter over said second path, 

operating said second data storage control indepen- 
dently of said first data storage control and in re- 
sponse to the receipt of each received data record 
write request and an accompanying data record for 
effecting the writing of said data record by said 
second group of disk drives, 

operating said second data storage control for receiv- 
ing a command sequence from said host computer 
requesting that multiple record copies be written 
for subsequently received data record write re- 
quests directed to a specified one of said disk drives 
of said second group of disk drives, 

operating said second data storage control in re- 
sponse to the subsequent receipt of a data record 
write request and accompanying data record di- 
rected to said specified one disk drive of said sec- 
ond group for transmitting said received record 
over said data link transmission path to said first 
data storage control, 

further operating said second data storage control 
independently of said first data storage control and 
in response to said subsequent receipt of said re- 
cord write request and accompanying data record 
for effecting the writing of said received record by 
said specified one disk drive of said second group 
of disk drives, and 

operating said first data storage control indepen- 
dently of said second data storage control and in 
response to the receipt of said record over said data 
link transmission path for effecting the writing of 
said record by a disk drive of said first group of 
disk drives. 

49. The method of claim 48 wherein said method 
further comprises the steps of: 

operating each data storage control in response to the 
receipt of a record by said each data storage con- 
trol for entering said received record into a cache 
memory of said each data storage control, 

returning a command complete signal to said host 
computer from said data storage control that re* 
ceives a record from said host computer when said 
record is entered into said cache memory of said 
each data storage control, and 

wherein said step of effecting a writing of each record 
comprises the step of applying a record in each 
cache memory to the disk drive connected to the 
data storage control containing said each cache 
memory to control the writing of said record by 
said disk drive. 

50. A method of operating a data storage system 
adapted to be connected over channel interface paths to 
a first and a second host computer for the writing of 
multiple copies of records received by said system over 
any of said paths from either of said host computers, 
said method comprising the steps of: 

operating a first and a second data storage control for 
receiving a data record from either of said host 
computers over one of said interface paths, 
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operating each data storage control independently of 
the other data storage control in response to the 
receipt of a data record over one of said paths for 
effecting the writing of said record by a disk drive 
of a group of drives to which only said each data 5 
storage control receiving said record is connected, 

operating said each data storage control in response 
to the receipt of said record over one of said paths 
for transmitting said record over a data link trans- 
mission path to the other one of said data storage 10 
controls, and 

operating said other data storage control indepen- 
dently of the other data storage control and in 
response to the receipt of said record over said data 
link transmission path for effecting the writing of 1 5 
said record by a disk drive of a group to which 
only said other one data storage control is con- 
nected. 

31. The method of claim 50 wherein said method 
further comprises the steps of: 20 

operating each data storage control in response to the 
receipt of said record over an interface path for 
entering said received record into a cache memory 
of each of said each data storage control, 

returning a command complete signal to said host 25 
computer from the data storage control thai re- 
ceives a record over a path when said received 
record is entered into said cache memory of each of 
said data storage controls, and 

wherein said step of effecting the writing of said 30 
received record comprises the step of applying said 
record in each cache memory to a disk drive of a 
group connected to the data storage control con- 
taining said each cachr memory to control the 
writing of said record by said disk drive of a group 35 
connected to said each data storage control. 

52. The method of claim 50 wherein said method 
further comprises the step of: 

returning a command complete signal to said host 
computer from said first data storage control after 40 
said record is written by a drive in each of said 
groups of disk drives. 

53. A method of operating a data storage system 
containing a plurality of data storage controls and 
adapted to be connected over channel interface paths to 45 
a first and a second host computer for the writing of 
multiple copies of records received by said system over 
any of said paths from either of said host computers, 
said method comprising the steps of: 

operating each data storage control independently of 50 
each other data storage control in response to the 
receipt of a data record over one of said paths from 
either of said host computers for effecting the writ- 
ing of said record by a disk drive of a group of 
drives to which only said each data storage control 55 
receiving said record is connected, 

operating said each data storage control in response 
to the receipt of said record over one of said paths 
for transmitting said record over a data link trans- 
mission path to another one of said data storage 60 
controls, 

operating said other data storage control indepen- 
dently of each other data storage control in re- 
sponse to the receipt of said record over said data 
link transmission path for effecting the writing of 65 
said record by a disk drive of a group of drives to 
which only said other one data storage control is 
connected, and 
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operating said other data storage control for extend- 
ing said received record over another data link 
transmission path to a third one of said data storage 
controls for the writing of said record by a disk 
drive of a group of drives to which only said third 
data storage control is connected. 
54. A method of operating a data storage system 
adapted to be connected over channel interface paths to 
a first and a second host computer for the writing of 
multiple copies of records received by said system over 
any of said paths from either of said host computers, 
said method comprising the steps of: 
operating each of m data storage controls for receiv- 
ing from one of said host computers channel pro- 
gram command sequences over one of said inter- 
face paths requesting the control of functions by 
said each data storage control including the writing 
of data records by a group of disk drives individual 
to and connected to said each data storage control, 
operating said each data storage control indepen- 
dently of each other data storage control and in 
response to the receipt of each program command 
sequence comprising a record write request and an 
accompanying record for effecting the writing of 
said accompanying record by a specified disk drive 
of the group of disk drives connected to said each 
data storage control with said disk drive being 
specified by said received write request, 
operating said each data storage control for receiving 
over an interface path a command sequence from 
said host computer requesting multiple copy ser- 
vice for a subsequently received write request and 
accompanying record directed to a specified one of 
said disk drives of said group of disk drives con- 
nected to said each data storage control, wherein 
said last named command sequence also specifies a 
disk drive in each of a group of n drives that is to 
be used to write multiple copies of a received re- 
cord for a subsequently received write request 
directed to said specified one drive of said group 
connected to said each data storage control, 
operating said each data storage control in response 
to the subsequent receipt of a command sequence 
comprising a record write request and an accompa- 
nying record directed to said specified one drive of 
said group connected to said each data storage 
control for transmitting said accompanying record 
over a data link transmission path to another data 
storage control connected by said data link to said 
each data storage control, 
further operating said each data storage control inde- 
pendently of each other data storage control and in 
response to the receipt of said subsequently re- 
ceived record write request and said accompany- 
ing record directed to said specified one disk drive 
of said group connected to said each data storage 
control for effecting the writing of said received 
record on said specified one disk drive of said 
group connected to said each data storage control, 
operating the one of said data storage controls con- 
nected by said data link to said each data storage 
control independently of each other data storage 
control and in response to the receipt of said record 
over said data link transmission path for effecting 
the writing of said record by a specified disk drive 
of said group connected to said one data storage 
control, and 



06/02/2003, EAST Version: 1.03.0002 



51 



5,155,845 



52 



operating said one data storage control connected by 
said link to said each data storage control indepen- 
dently of each other data storage control and in 
response to the receipt of said record over said data 
link transmission path for extending said received 5 
record over another data link transmission path to 
a third one of said data storage controls for both 
controlling the writing of said record on a specified 
disk drive connected to said third data storage 
control and for further extending said record over 10 
a data link transmission path to another data stor- 
age control so that each remaining one of said data 
storage controls receiving said record over a data 
link transmission path controls the writing of said 
record by a disk drive connected to said each re- 15 
maining data storage control. 

55. A method of operating a data storage system 
adapted to be connected to a host computer, said 
method comprising the steps of: 

operating a first one of m data storage controls inde- 20 
pendently of each other data storage control and in 
response to the receipt of a record from said host 
computer for effecting the writing of said record 
by a first disk drive connected to said first data 
storage control, 25 

operating said first data storage control in response to 
the receipt of said record for transmitting said re- 
cord over a data link transmission path to a second 
data storage control, 

operating said second data storage control indepen- 30 
dently of each other data storage control and in 
response to the receipt of said record for effecting 
the writing of said record by a second disk drive 
connected to said second data storage control, and 

further operating said second data storage control in 35 
response to said receipt of said record for extending 
said record over a data link transmission path to 
other data storage controls so that said other data 
storage controls each receive said record and con- 
trol the writing of said record by a disk drive con- 40 
nected to said other data storage controls. 

56. A method of operating a data storage system 
having a first and a second data storage control and 
adapted to be connected to a host computer, said 
method comprising the steps of: 45 

operating said first data storage control indepen- 
dently of said second data storage control for re- 
ceiving channel program command sequences over 
an interface path from said host computer request- 
ing the control of functions by said first data stor- SO 
age control including the writing of data records 
by a first group of disk drives connected to said 
first data storage control, 

operating said first data storage control indepen- 
dently of said second data storage control and in 55 
response to the receipt of each program command 
sequence comprising a record write request and an 
accompanying record for effecting the writing of 
said accompanying record by a disk drive of said 
first group, 60 

operating said first data storage control for receiving 
a command sequence from said host computer 
requesting multiple copy service for a subsequently 
received write request directed to a specified one 
of said disk drives of said first group, wherein said 65 
last names command sequence specifies a disk drive 
of each of said first and a second group of drives 
connected to said second data storage control that 



is to be used to write said multiple copies of a re- 
cord accompanying a subsequently received write 
request and directed to said specified one drive of 
said first group, 

operating said first data storage control in response to 
the subsequent receipt of a command sequence 
comprising a record write request and an accompa- 
nying record directed to said specified one drive of 
said first group for transmitting said accompanying 
record over a data link transmission path to said 
second data storage control, 

further operating said first data storage control inde- 
pendently of said second data storage control and 
in response to the receipt of said subsequently re- 
ceived record write request and an accompanying 
record directed to said specified one disk drive of 
said first group for effecting the writing of said 
received record by said specified one disk drive of 
said first group, and 

operating said second data storage control indepen- 
dently of said first data storage control and in re- 
sponse to the receipt of said record over said data 
link transmission path for effecting the writing of 
said record by said specified disk drive of said 
second group. 

57. The method of claim 56 wherein said channel 
program command sequence comprises: 

commands arranged according to a predetermined 
channel program command format with at least 
some of said commands having a parameter list 
associated therewith and at least one of said com- 
mands having an information block associated 
therewith, 

said parameter lists and said information block being 
adapted to contain data arranged into either a first 
or a second data format, 

said parameter list and said information block data 
being in a first format when a received channel 
program command sequence comprises a request 
for the subsequent provision of multiple copy ser- 
vice for records subsequently written to said speci- 
fied one disk drive of said first group of disk drives, 

said parameter list being in a second format when a 
received command sequence comprises a record 
write request. 

58. The method of claim 57 wherein said method 
further comprises the steps of: 

operating said second data storage control in re- 
sponse to the receipt of said record for transmitting 
said record over a second data link transmission 
path to a third data storage control, and 

operating said third data storage control indepen- 
dently of said first data storage control and said 
second data storage control and in response to the 
receipt of said record for effecting the writing of 
said record by a disk drive of a third group of disk 
drives connected to said third data storage control. 

59. The method of claim 57 wherein said method 
further comprises the steps of: 

operating each data storage control in response to the 
receipt of a record by said each data storage con- 
trol for entering said received record into a cache 
memory of said each data storage control, 

returning a command complete signal said to said 
host computer from said first data storage control 
when each record received by a data storage con- 
trol is entered into said cache memory of each data 
storage control, and 
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wherein said step of effecting the writing of each of 
said records comprises the step of applying each 
record in a cache memory to the disk drive con- 
nected to the data storage control containing each 
cache memory. 

60. The method of claim 57 wherein said method 
further comprises the steps of: 

returning a command complete signal from said first 
data storage control to said host computer after 
said record is written by each of said disk drives. 

61. The method of claim 57 wherein said method 
further comprises the steps of: 

transmitting channel program command sequences to 
said second data storage control over a second 
channel interface path extending from said host 
computer to said second data storage control, 

operating said second data storage control for receiv- 
ing channel program command sequences over 
said interface path from said host computer re- 
questing the control of functions by said second 
data storage control including the writing of data 
records by said second group of disk drives, 

operating said second data storage control indepen- 
dently of said first data storage control and in re- 
sponse to the receipt of each program command 
sequence comprising a record write request for 
effecting the writing of a record accompanying 
said request by a disk drive of said second group as 
specified by said received write request, 

operating said second data storage control for receiv- 
ing a command sequence from said host computer 
requesting multiple copy service for subsequently 
received record write requests directed to a speci- 
fied one of said disk drives of said second group, 
wherein said last named command sequence speci- 
fies a disk drive of each of said first and second 
groups that is to be used to write said multiple 
copies of records for subsequently received write 
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any of said paths from either of said host computers, 
said system comprising: 

operating each of a first and a second data storage 
control for receiving a data record from either of 
said host computers over said paths, 

operating said each data storage control indepen- 
dently of the other data storage control and in 
response to the receipt of each write request and an 
accompanying data record over a path from said 
host computer for effecting the writing of said 
accompanying record by a disk drive of a group to 
which said each data storage control is connected, 

operating each of said data storage controls for re- 
ceiving a request from said host computer for the 
provision of multiple copy service upon the subse- 
quent receipt of a record write request directed to 
a specified one disk drive of a group connected to 
said each data storage control, 

operating each of said data storage controls indepen- 
dently of the other data storage control and in 
response to the subsequent receipt of a write re- 
quest and an accompanying data record directed to 
said specified one disk drive for controlling the 
writing of said accompanying record by the speci- 
fied drive connected to said each data storage con- 
trol and for transmitting said record over said data 
link transmission path to the other one of said data 
storage controls, and 

operating said other data storage control indepen- 
dently of the other data storage control and in 
response to the receipt of said record for effecting 
the writing of said record by the one of said disk 
drives to which said other one data storage control 
is connected. 

63. A method of operating a data storage system 
adapted to be connected over first and second channel 
interface paths, respectively, to a first and a second host 
computer, respectively, for the writing of a single copy 



requests to said specified one drive of said second 40 of records received by said system over any of said 



group, 

operating said second data storage control in re- 
sponse to the subsequent receipt of a command 
sequence comprising a record write request and an 
accompanying data record directed to said sped- 45 
fied one disk drive of said second group of disk 
drives for transmitting said accompanying record 
over said data link transmission path to said first 
data storage control, 

further operating said second data storage control 50 
independently of said first data storage control and 
in response to the receipt of said subsequently re- 
ceived record write request and an accompanying 
data record directed to said specified one disk drive 
of said second group of disk drives for effecting the 55 
writing of said accompanying record by said speci- 
fied one disk drive of said second group of disk 
drives, and 

operating said first data storage control indepen- 



dently of said second data storage control and in 60 prises the steps of: 



paths from either of said host computers, said method 
comprising the steps of: 
operating a first data storage control for receiving a 
data record write request and an accompanying 
data record over said first path from said first host 
computer, 

operating a second data storage control for receiving 
a data record write request and an accompanying 
data record over said second path from said second 
host computer, and 

operating each data storage control in response to the 
receipt of each write request by said each data 
storage control for effecting the writing of the data 
record accompanying each request by only a disk 
drive to which said second data storage control is 
connected. 

64. The method of claim 63 wherein said data storage 
controls are interconnected by a direct data link trans- 
mission path and wherein said method further corn- 



response to the receipt of said record over said data 
link transmission path for effecting the writing of 
said record by said specified disk drive of said first 
group of disk drives. 
62. A method of operating a data storage system 65 
adapted to be connected over channel interface paths to 
a first and a second host computer for the writing of 
duplicate copies of record received by said system over 



operating said first data storage control in response to 
said write request from said host computer for 
transmitting said record accompanying said re- 
quest over said data link transmission path to said 
second data storage control, and 
operating said second data storage control in re- 
sponse to the receipt of said record over said data 
link transmission path for writing said record on 
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said disk drive to which said second data storage 
control is connected. 

65. The method of claim 64 in combination with the 
additional steps of: 

operating said second data storage control in re- 5 
sponse to a receipt of a record read request from 
said second host computer for reading said record 
by said disk drive to which said second data stor- 
age control is connected, 

transmitting said read record over said second chan- 10 
net interface path to said second host computer, 

operating said first data storage control in response to 
a receipt of a record read request from said first 
host computer for receiving said record from said 
second data storage control over said data link 15 
transmission path, and 

transmitting said record received over said data link 
transmission path to said first host computer from 
said first data storage control over said first chan- 
nel interface path. 20 

66. A method of operating a data storage system 
adapted to be connected over first and second channel 
interface paths, respectively, to a first and a second host 
computer, respectively, for the writing of a single copy 
of records received by said system over any of said 25 
paths from either of said host computers, said method 
comprising the steps of: 

operating a first data storage control for receiving a 
data record write request and an accompanying 
data record over said first path from said first host 30 
computer, 

operating a second data storage control for receiving 
a data record write request and an accompanying 
data record over said second path from said second 
host computer, 35 

operating said second data storage control in re- 
sponse to the receipt of each write request from 
said second host computer and directed to a speci- 
fied disk drive connected to said second data stor- 
age control for effecting the writing of said record 40 
accompanying each request by said specified disk 
drive to which said second data storage control is 
connected, 

operating said first data storage control for receiving 
a request from said first host computer for the 45 
provision of shared service upon the subsequent 
receipt of a record write request and an accompa- 
nying data record directed to a specified phantom 
drive of a group of disk drives connected to said 
first data storage control 50 

operating said first data storage control in response to 
the subsequent receipt of each write request and an 
accompanying data record not directed to said 
phantom drive of said first data storage control for 
effecting the writing of the record accompanying 55 
each request by a disk drive of a group to which 
said first data storage control is connected, 

operating said first data storage control in response to 
the subsequent receipt of a write request and an 
accompanying data record directed to said speci- 60 
fied phantom disk drive for transmitting said re- 
cord over a data link transmission path to said 
second data storage control, and 

operating said second data storage control in re- 
sponse to the receipt of said record over said data 65 
link transmission path for effecting the writing of 
said record by a disk drive to which said second 
data storage control is connected. 



67. A method of operating a data storage system 
adapted to be connected to a first and a second host 
computer for the sharing of records by users of both of 
said computers, said method comprising the steps of: 

operating a first data storage control for receiving 
channel program command sequences over a first 
interface path from said first host computer re- 
questing the control of system functions by said 
first data storage control including the writing and 
reading of data records by a first group of disk 
drives connected to said first data storage control, 

operating said first data storage control in response to 
the receipt from said first host computer of each 
program command sequence comprising a record 
write request and an accompanying data record for 
effecting the writing of a said accompanying data 
record by a disk drive of said first group as speci- 
fied by said received write request, 

operating a second data storage control for receiving 
channel program command sequences over a sec- 
ond interface path from said second host computer 
requesting the control of functions by said second 
data storage control including the writing and 
reading of data records by a second group of disk 
drives connected to said second data storage con- 
trol, 

operating said second data storage control in re- 
sponse to the receipt from said second host com- 
puter of each program command sequence com- 
prising a data record write request and an accom- 
panying data record for effecting the writing of 
said accompanying data record by a disk drive of 
said second group as specified by said write request 
received by said second data storage control, 

operating said first data storage control for receiving 
a command sequence from said first host computer 
requesting the establishment of extended connec- 
tivity service for subsequently received write re- 
quests directed to a specified phantom disk drive of 
said first group, wherein said last named command 
sequence also specifies a disk drive of said second 
group of drives that is to be used to write a copy of 
a received record accompanying each subse- 
quently received write request directed to said 
specified phantom drive of said first group, 

operating said first data storage control in response to 
a subsequent receipt of a command sequence com- 
prising a record write request and an accompany- 
ing data record directed to said specified phantom 
drive of said first group of drives for transmitting 
said accompanying data record over a direct data 
link transmission path to said second data storage 
control, and 

operating said second data storage control in re- 
sponse to the receipt of said record over said data 
link transmission path for effecting the writing of 
said data record by said specified disk drive of said 
second group. 

68. The method of claim 67 in combination with the 
additional steps of: 

operating said first data storage control in response to 
a subsequent receipt of a command sequence com- 
prising a record read request directed to said speci- 
fied phantom drive of said first group for transmit* 
ting a message containing said read request over 
said direct data link transmission path to said sec- 
ond data storage control, 
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operating said second data storage control in re- 
sponse to the receipt of said record read request 
over said data link transmission path for effecting 
the reading of said requested data record by said 
specified disk drive of said second group contain- 5 
ing said requested record, 

transmitting said read data record over said data link 
transmission path from said second data storage 
control to said first data storage control, 

operating said first data storage control in response to 
the receipt of said data record over said data link 10 
transmission path from 

said second data storage control for transmitting said 
data record over said first interface path to said 
first host computer, 

operating said second data storage control in re- 15 
spouse to a subsequent receipt from said second 
host computer of a command sequence comprising 
a data record read request directed to a specified 
drive of said second group for reading said data 
record from said specified drive of said second 
group, and 

transmitting said read data record over said second 
interface path to said second host computer. 

69. The method of claim 67 wherein said channel 
program command sequence requesting the establish- 
ment of extended connectivity service comprises: 25 

commands arranged according to a predetermined 
channel program command format with at least 
some of said commands having a parameter list 
associated therewith and al least one of said com- 
mands having an information block associated 30 
therewith, 

said parameter lists and said information block data 
being in a first format when a received channel 
program command sequence comprises a request 
for the subsequent provision of said extended con- 35 
nectiviiy service for subsequently received write 
requests directed to said specified phantom drive of 
said first group of disk drives, 

said parameter list being in a second format when a 
received command sequence comprises a data re- 
cord write request. 40 

70. A method of operating a data storage system 
adapted to be connected to a first and a second host 
computer, said method comprising the steps of: 

operating a first data storage control for receiving 
channel program command sequences over a first *5 
interface path from said first host computer re- 
questing the control of system functions by said 
first data storage control including the writing and 
reading of data records by a first group of disk 
drives connected to said first data storage control, 50 

operating said first data storage control in response to 
the receipt from said first host computer of each 
program command sequence comprising a record 
write request and an accompanying data record for 
effecting the writing of a said accompanying data J5 
record by a disk drive of said first group as identi- 
fied by said received write request, 

operating a second data storage control for receiving 
channel program command sequences over a sec- 
ond interface path from said second host computer 
requesting the control of functions by said second 60 
data storage control including the writing and 
reading of data records by a second group of disk 
drives connected to said second data storage con- 
trol, 

operating said second data storage control in re- 65 
sponse to the receipt from said second host com- 
puter of each program command sequence com- 
prising a record write request and an accompany- 
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ing data record for effecting the writing of said 
accompanying data record by a disk drive of said 
second group as identified by said write request 
received by said second data storage control, 
operating said first data storage control for receiving 
a command sequence from said first host computer 
requesting the establishment of extended service 
for subsequently received write requests directed 
to a specified disk drive of said first group, wherein 
said last named command sequence also specifies a 
disk drive of said second group of drives that is to 
be used to write a copy of a received record ac- 
companying each subsequently received write re- 
quest directed to said specified disk drive of said 
first group, 

operating said first data storage control in response to 
a subsequent receipt of a command sequence com- 
prising a record write request and an accompany- 
ing data record directed to said specified drive of 
said first group of drives for transmitting said ac- 
companying record over a direct data link trans- 
mission path to said second data storage control, 

operating said second data storage control in re- 
sponse to the receipt of said data record over said 
data link transmission path for effecting the writing 
of said record by said specified disk drive of said 
second group, 

operating said first data storage control in response to 
a subsequent receipt of a command sequence com- 
prising a record write request and an accompany- 
ing data record directed to said specified drive of 
said first group of drives for effecting the writing of 
said record by said specified disk drive of said first 
group if said specified disk drive of said first group 
is not a phantom disk drive, and 

inhibiting the writing of said accompanying record 
by a disk drive of said first group if said specified 
disk drive of said first group is a phantom disk 
drive. 

71. A method of operating a data storage system 
adapted to be connected to a host computer, said 
method comprising the steps of: 
operating a first one of m independently operable 
data storage controls in response to the receipt of a 
record from said host computer for effecting the 
writing of said record by a first disk drive con- 
nected to said first data storage control, 
operating said first data storage control in response to 
the receipt of said record for transmitting said re- 
cord over a data link transmission path to a second 
data storage control, 
operating said second data storage control indepen- 
dently of said first data storage control in response 
to the receipt of said record for effecting the writ- 
ing of said record by a second disk drive connected 
to said second data storage control, 
further operating said second data storage control in 
response to said receipt of said record for extending 
said record over a data link transmission path to 
other data storage controls, 
operating said other data storage controls to receive 
said record over said data link transmission path, 
and 

further operating said other data storage controls 
independently of each other data storage control so 
that said record is written by disk drives of less 
than all of said other data storage controls whereby 
said system writes less than m copies of said record 
received from said host computer by said first data 
storage control. 



06/02/2003, EAST Version: 1.03.0002 



